>>> [!note] Migrated issue <!-- Drupal.org comment --> <!-- Migrated from issue #3549959. --> Reported by: [marcus_johansson](https://www.drupal.org/user/385947) >>> <h3 id="summary-problem-motivation">Problem/Motivation</h3> <p>Currently all upgrade testing has been with either Drupal Standard installation with all the modules installed or Drupal CMS with the agents installed and it has assumed that you update AI, AI Agents and the provider to 1.2.x branch. This has been working, however there are combinations that has not yet been tested that are possible.</p> <ul> <li>AI 1.2.0, AI Agents 1.1.0 and AI provider 1.0.x is even probable for any provider being used that hansn't updated to function calling.</li> </ul> <p>VDB providers we can assume 1.1.x should be added since its a breaking change. We should test these upgrade paths so:</p> <ol> <li>At least they do not break your website.</li> <li>Better - everything that isn't the assistant, agents, tool explorer or chat explorer with tools works well.</li> <li>Event better - you have graceful fallback on assistants and agents that already exists.</li> <li>Best - you have information that you should update (&lt;- this would require updated code)</li> </ol> <h4 id="how-to-test">How to test</h4> <p>Step #1:</p> <ol> <li>Install Drupal Standard installation.</li> <li>Fetch AI 1.1.5, AI Agents 1.1.2, OpenAI Provider 1.1.2 (Its the most used provider), Milvus Provider 1.1.2-beta2, ?(OpenAI provider version)</li> <li>Install AI Core, AI API Explorer, AI Logging, AI Automators, AI CKEditor integration, AI Content Suggestions, AI External Moderation, AI Translate, AI Search, OpenAI Provider, AI Agents, AI Assistant API, AI Chatbot, Milvus VDB Provider..</li> <li>Setup OpenAI</li> <li>Setup Milvus</li> <li>Visit filter formats (/admin/config/content/formats) and add the AI CKEditor button to the full html. Setup Summarize.</li> <li>Visit AI logging settings (/admin/config/ai/logging/settings) and enable Automatically Log Requests and Automatically Log Responses.</li> <li>Visit AI Content Suggestions Settings (/admin/config/ai/suggestions) and enabled Summarise text (we should be consistent with summarise/summarize here :) )</li> <li>Visit AI Assistant configuration (/admin/config/ai/ai-assistant) and setup an assistant using the content type agent - you can give the simple instruction "Forward all calls to the Content Type Agent"</li> <li>Setup a Chatbot, make sure its not streaming, use the assistant.</li> <li>Visit Search APi (/admin/config/search/search-api) and setup an server and index pointing at your Milvus and using Articles.</li> <li>Create a new content type called "Test Automators", where you add a String Long text and enable LLM Text Simple and base it on the title and ask it to write a two sentence story.</li> <li>Visit Automator chain settings (/admin/config/ai/automator_chain_types) and add an chain called "Story teller" and add a text field and a long text and make the long text write a story of the text field. Set the text field to required.</li> <li>Visit filter formats (/admin/config/content/formats) again and connect this automator chain where the text field is the input and story field is the output.</li> <li>Add 10 articles - when creating them try the CKEditor assistants and the Content Suggestions.</li> <li>Run Search API Indexing if needed.</li> <li>Setup a view using the index.</li> <li>Try searching.</li> <li>Try to create using the Test Automators by just filling in the title.</li> <li>Try asking the Chatbot "What content type exists on the system?"</li> <li>Take a database dump</li> <li>Add a language</li> <li>Try to translate an article using AI translate</li> </ol> <p>Test #1</p> <ol> <li>Upgrade the AI module to 1.2.x-dev</li> <li>Run drush updb or the update.php</li> <li>Flush caches</li> <li>Try to add an article with the CKEditor assistants tools and Content Suggestions.</li> <li>Try to translate an article using AI translate</li> <li>Try to index it.</li> <li>Check the view if its there and search for it.</li> <li>Try Test Automators</li> <li>Try asking the Chatbot "What content type exists on the system?</li> <li>Visit /admin/config/ai/automator_chain_types</li> <li>Visit /admin/config/ai/automator_chain_types/add</li> <li>Visit /admin/config/ai/ai-automators/automators-tool</li> <li>Visit /admin/config/ai/ai-automators/automators_tool/add</li> <li>Visit /admin/config/ai/ai-assistant/add</li> <li>Visit edit page of the assistant you setup</li> <li>Visit /admin/config/content/formats/manage/full_html</li> <li>Visit /admin/config/ai/agents</li> <li>Check /admin/reports/status for status errors</li> <li>Check /admin/reports/dblog for errors that might be connected to the upgrade</li> </ol> <p>Test #2</p> <ol> <li>Upgrade the AI Agents module to 1.2.x-dev</li> <li>Run drush updb or the update.php</li> <li>Flush caches</li> <li>Try to add an article with the CKEditor assistants tools and Content Suggestions.</li> <li>Try to translate an article using AI translate</li> <li>Try to index it.</li> <li>Check the view if its there and search for it.</li> <li>Try Test Automators</li> <li>Try asking the Chatbot "What content type exists on the system?</li> <li>Visit /admin/config/ai/automator_chain_types</li> <li>Visit /admin/config/ai/automator_chain_types/add</li> <li>Visit /admin/config/ai/ai-automators/automators-tool</li> <li>Visit /admin/config/ai/ai-automators/automators_tool/add</li> <li>Visit /admin/config/ai/ai-assistant/add</li> <li>Visit edit page of the assistant you setup</li> <li>Visit /admin/config/content/formats/manage/full_html</li> <li>Visit /admin/config/ai/agents</li> <li>Check /admin/reports/status for status errors</li> <li>Check /admin/reports/dblog for errors that might be connected to the upgrade</li> </ol> <p>Test #2</p> <ol> <li>Upgrade the AI OpenAI module to 1.2.x-dev</li> <li>Run drush updb or the update.php</li> <li>Flush caches</li> <li>Try to add an article with the CKEditor assistants tools and Content Suggestions.</li> <li>Try to translate an article using AI translate</li> <li>Try to index it.</li> <li>Check the view if its there and search for it.</li> <li>Try Test Automators</li> <li>Try asking the Chatbot "What content type exists on the system?</li> <li>Visit /admin/config/ai/automator_chain_types</li> <li>Visit /admin/config/ai/automator_chain_types/add</li> <li>Visit /admin/config/ai/ai-automators/automators-tool</li> <li>Visit /admin/config/ai/ai-automators/automators_tool/add</li> <li>Visit /admin/config/ai/ai-assistant/add</li> <li>Visit edit page of the assistant you setup</li> <li>Visit /admin/config/content/formats/manage/full_html</li> <li>Visit /admin/config/ai/agents</li> <li>Check /admin/reports/status for status errors</li> <li>Check /admin/reports/dblog for errors that might be connected to the upgrade</li> </ol> <p>These tests can later be created into recipes and kernel tests.</p>