>>> [!note] Migrated issue <!-- Drupal.org comment --> <!-- Migrated from issue #3493865. --> Reported by: [andrewbelcher](https://www.drupal.org/user/655282) Related to !338 >>> <p>We need a mechanism for running tests against real LLMs to test that the integrations behave as expected. As LLMs are not deterministic and costly, this should be separated from normal tests. Initially these would be manually run locally.</p> <p>As part of this, we want to be able to use these tests for trialling changes to prompts etc via a UI. The actual UI will be a separate project, as we won't want it or it's dependencies installed on normal sites.</p>