Run an experiment to test AI review of Merge Requests
>>> [!note] Migrated issue <!-- Drupal.org comment --> <!-- Migrated from issue #3583730. --> Reported by: [hestenet](https://www.drupal.org/user/54034) >>> <p>[Tracker]<br> <strong>Update Summary: </strong>[One-line status update for stakeholders]<br> <strong>Check-in Date: </strong>MM/DD/YYYY<br> <strong>Additional Collaborators: </strong><br> <em>Metadata is used by the <a href="https://www.drupalstarforge.ai/" title="AI Tracker">AI Tracker.</a> Docs and additional fields <a href="https://www.drupalstarforge.ai/ai-dashboard/docs" title="AI Issue Tracker Documentation">here</a>.</em><br> [/Tracker]</p> <h3 id="summary-problem-motivation">Problem/Motivation</h3> <p>The more AI generated material gets used in making Merge Requersts, the more likely it is to go off the rails and not follow Drupal coding standards, or refactor much more than it should, etc, etc. </p> <p>We would like to find ways to reduce the burden this creates on maintainers - and one option is fighting fire with fire. There are some AI code review tools that could be integrated into the CI process to help mitigate things.</p> <h3 id="summary-proposed-resolution">Proposed resolution</h3> <p>We should list the options</p> <ul> <li>coderabbit.ai/oss - Has a free for open source program - would need to see if it can integrate with GitLab CI on a self-hosted instance</li> <li>qodo.ai- Has a free for open source program - but GitHub integration only so far</li> </ul> <h3 id="summary-remaining-tasks">Target date or deadline</h3> <p>No specific date, but we should try to run against some of the AI-initiative contrib projects. Or any other maintainer who is willing to try.</p> <h3 id="summary-remaining-tasks">Remaining tasks</h3> <p>- Evaluate providers<br> - Decide on one<br> - Nominate test projects<br> - Run tests:<br> - AI reviewing AI generated<br> - AI reviewing human code</p> <h3 id="summary-ai-usage">AI usage (if applicable)</h3> <p>[ ] AI Assisted Issue<br> This issue was generated with AI assistance, but was reviewed and refined by the creator.</p> <p>[ ] AI Assisted Code<br> This code was mainly generated by a human, with AI autocompleting or parts AI generated, but under full human supervision.</p> <p>[ ] AI Generated Code<br> This code was mainly generated by an AI with human guidance, and reviewed, tested, and refined by a human.</p> <p>[ ] Vibe Coded<br> This code was generated by an AI and has only been functionally tested.</p> > Related issue: [Issue #3581443](https://www.drupal.org/node/3581443)
issue