Drupal AI Contribution meetup 2025.3 (#3503762) · Issues · project / ai

Drupal AI Contribution meetup 2025.3

>>> [!note] Migrated issue   Reported by: [valthebald](https://www.drupal.org/user/239562) >>> Drupal AI Contribution meetup from 13 Feb, 2025 at 13:00 UTC to 14 Feb 2025 13:00 UTC (Check your local time at <a href="https://www.timebie.com/std/universal.php">https://www.timebie.com/std/universal.php</a>) <h2>Attendees</h2> (in the order of appearance in the chat) <h2>Agenda</h2> <h3>Follow-up to topics of <a href="https://www.drupal.org/project/ai/issues/3502459" title="Status: Closed (fixed)">#3502459: Drupal AI Contribution meetup 2025.2</a></h3> <h3>Current progress in AI core and the ecosystem</h3> <ul> <li><a href="https://www.drupal.org/project/ai/issues/3479388" title="Status: Closed (fixed)">#3479388: Research normalize function calling in Chat operator</a></li> <li><a href="https://www.drupal.org/project/ai/issues/3492869" title="Status: Closed (fixed)">#3492869: Normalize Structured responses</a></li> <li><a href="https://www.drupal.org/project/ckeditor_ai_agent/releases/1.0.0-beta3">https://www.drupal.org/project/ckeditor_ai_agent/releases/1.0.0-beta3</a></li> </ul> <li>Hello everyone, and welcome to the Drupal AI contribution meeting!This meeting:➤ Happens every other week in #drupal-cms-ai channel➤ Is text only!➤ Happens in threads, which you can follow to be notified of new replies even if you don’t comment in the thread. You may also join the meeting later and participate asynchronously.➤ Refers to various issues and plans tracking in d.o project:<a href="https://www.drupal.org/project/ai/issues/3503762" title="Status: Closed (fixed)">#3503762: Drupal AI Contribution meetup 2025.3</a>.Please comment there so we can grant you credit for attending/contributing! Please note, we will only give attributions for active engagement. <ul> </ul></li> <li>0️⃣ Roll call! Who's here? What's your favorite code-writing AI assistant (if any)? Please mention your d.o. username <ul> <li>thejimbirch: thejimbirch Only using chatGPT for the moment. Here to help with recipes if needed and to keep up.</li> <li>Marcus Johansson: Marcus (marcus_johansson).  I'm still stuck on co-pilot for minor autocomplete and writing unit tests, but I'm testing others with more features, with different results.</li> <li>valthebald: Val (valthebald) I got best results with JetBrains AI assistant while I had my trial (sometimes works like magic!)second best is <a href="http://continue.dev">continue.dev</a> plugin followed by Proxy AI</li> <li>yautja_cetanu (Jamie): Jamie - yautja_cetanu also chatgpt for me 🙂 (edited)</li> <li>Jayjitraj jadeja: j2r - Mostly ChatGPT good to get the skeleton code</li> <li>Joonas Meriläinen: mErilainen, using GitHub Copilot (edited)</li> </ul></li> <li>1️⃣ Followup from the previous meeting <ul> <li>valthebald: <a href="https://www.drupal.org/project/ai/issues/3494281" title="Status: Closed (fixed)">#3494281: CKEditor icon when in Gin Dark mode</a> - fixed</li> <li>valthebald: <a href="https://www.drupal.org/project/ai/issues/3499597" title="Status: Closed (fixed)">#3499597: Better error handling in the AI Chatbot</a>- fixed</li> </ul></li> <li>1️⃣ 1️⃣ Bringing ai_search out of experimental[#3485449] <ul> <li>valthebald: nice summary from @Seogow but no progress, unfortunately</li> </ul></li> <li>1️⃣ 2️⃣ Unifying translation approach[#3478721] <ul> <li>valthebald: this got merged into 1.0.4! yay!</li> <li>valthebald: and as far as I know, ai_tmgmt already uses this functionality</li> </ul> </li> <li>1️⃣ 3️⃣ Drupal AI website <ul> <li>valthebald: @yautja_cetanu (Jamie) what can we do to unblock this?</li> </ul> </li> <li>1️⃣ 4️⃣ Programmatically add operation type <ul> <li>valthebald: <a href="https://www.drupal.org/project/ai/issues/3500120" title="Status: Closed (fixed)">#3500120: Programmatically add OperationType in AiProviderPluginManager</a> is marked RTBC :+1:</li> </ul> </li> <li>2️⃣ Normalizing topics from @Marcus Johansson <ul> </ul> </li> <li>2️⃣ 1️⃣ functions in chat operator[#3479388] <ul> <li>valthebald: <a href="https://www.youtube.com/watch?v=QVGRMWEpjlA&ab_channel=DrupalAIVideos">https://www.youtube.com/watch?v=QVGRMWEpjlA&ab_channel=DrupalAIVideos</a></li> <li>yautja_cetanu (Jamie): I'm hoping to get a blog post aobut it today. Had a really good conversation with @michaellander about this and the "Drupal Contexts" side of things.</li> <li>michaellander: After talking with @yautja_cetanu (Jamie), I'm going to try to put together a PoC around context collecting.. I think starting with a hand full of 'test' prompts that require context to be gathered different ways  and being able to get the right information back.  I will keep you posted.  Then the conversation becomes around how much explaining is necessary to keep AI agents/tools on rails and trustworthy vs letting it try to navigate some of it on it's own.  And I think the consensus is 'Yes'... We should try everything.  But designing for the later should make the former that much easier.</li> <li>Jasper Lammens: Very interested to see more of this 🙂</li> <li>Jasper Lammens: I’ll work on the MCP-integration of ECA before and after Drupal Mountain Camp. So I’ll showcase something afterwards as well</li> <li>Jasper Lammens: Let’s see if we can find similarities and a middle ground to further with this</li> <li>Jasper Lammens: <a href="https://docs.mcp.run/blog/2025/02/13/announcing-tasks/">https://docs.mcp.run/blog/2025/02/13/announcing-tasks/</a></li> <li>Jasper Lammens: @yautja_cetanu (Jamie) is it something like this you had in mind?</li> </ul></li> <li>2️⃣ 2️⃣ Structured responses[#3492869] <ul> <li>valthebald: <a href="https://www.youtube.com/watch?v=fyCd2fwR4RQ&ab_channel=DrupalAIVideos">https://www.youtube.com/watch?v=fyCd2fwR4RQ&ab_channel=DrupalAIVideos</a></li> <li>Scott Euser: I don't have anything constructive to say other than that I think this is super useful. Will be great for other contrib modules to leverage as well + eventually help with migration related things</li> </ul></li> <li>3️⃣ Other topics to discuss <ul> </ul> </li> <li>3️⃣ 1️⃣ Topics without issues on d.o. <ul> <li>valthebald: Improve the errors the assistant gives for common errorsAdd chat history to deepchatTweaks of alt text generatorPlanning assistant(edited)</li> <li>valthebald: are those still relevant? if yes, I can create issues if still not created</li> <li>Marcus Johansson: Improve the errors the assistant gives for common errors <- This is in AI module since 1.0.4 and also in Drupal CMS 1.0.2.</li> <li>valthebald: marked</li> <li>yautja_cetanu (Jamie): I can't remember what Chat history to deepchat is?</li> <li>yautja_cetanu (Jamie): Don't we have chat history? Is this more about being able to swap between threads or store history in the database?</li> <li>valthebald: I guess, similar to OpenAI memory? (sorry, not that familiar with deepchat)</li> <li>valthebald: does it already have history between sessions?</li> <li>yautja_cetanu (Jamie): It has history in the sessions, but not between sessions</li> <li>yautja_cetanu (Jamie): So if you close the page and come back it will still be there</li> <li>yautja_cetanu (Jamie): but "Clear chat" or leave it for a day that will kill the history</li> <li>yautja_cetanu (Jamie): so maybe "Long Term chat history" is better?</li> <li>valthebald: yes, something like that</li> <li>yautja_cetanu (Jamie): We need a UI that allows you to save new "Chats" or threads and delete them then I think like in <a href="http://chat.openai.com">chat.openai.com</a> if you have long term history</li> </ul></li> <li>3️⃣ 2️⃣ Branch 1.1.x is open <ul> <li>valthebald: I think default branch should be changed to 1.1.x, and development release 1.1.x as well</li> <li>valthebald: also, I'd encourage people to open new issues against 1.1.x (when not 1.0.x-specific), with backporting after the fix</li> </ul> </li> <li>3️⃣ 3️⃣ Decoupled deep chat <ul> <li>valthebald: AI assistant not necessarily should reside on the site itself, right?</li> <li>valthebald: so, if we have oauth authorization on the chat side, we can communicate(and command) Drupal without entering it.</li> <li>valthebald: This will allow progress in bot implementations via Telegram (allows mini-applications) and probably WhatsApp.</li> <li>valthebald: What do you think?</li> <li>yautja_cetanu (Jamie): I think DeepChat is already decoupled? So we could have what you want now but it would need some module for that.</li> <li>valthebald: it well may be! it's just I always saw it on drupal admin pages, not outside of it</li> <li>valthebald: something that I'm eager to try 🙂</li> <li>yautja_cetanu (Jamie): Well which way round do you mean:Do you mean DeepChat is able to interface with things that arn't AI Assistants and so control AI Agents provided by some external system (like langchain?)Or do you mean, that Assistants is decoupled from DeepChat, in that you can use a different front-end chatbot to control the same assistant (including external ones such as Whatsapp or Delegram)</li> <li>valthebald: I mean, when DeepChat is outside of Drupal site, it needs some authentication mechanism. I.e. you don't want some anonymous user to add fields or define content types</li> <li>yautja_cetanu (Jamie): So I think the MCP module is aiming to provide that</li> <li>yautja_cetanu (Jamie): It looks like MCP currently only supports working with software locally but they are improving it to allow for authentication over the web</li> <li>valthebald: I hope @Giorgi Jibladze can attend today's discussion</li> </ul></li> <li>4️⃣ Open mike! Suggest your topic <ul> <li>Nick Opris: I was trying to build a map of all AI related modules in Drupal. I would love to know if there is a way to run a command (maybe in composer) to find all modules which require any of the core  AI ones.</li> <li>valthebald: there is this one[#3429343]</li> <li>Nick Opris: If I can automate that list then I can have a live page automatically updated.</li> <li>Nick Opris: Is that list manually maintained?</li> <li>valthebald: I think yes</li> <li>valthebald: you can get the full list of available packages with composer composer show -a | grep drupal (edited)</li> <li>valthebald: and then maybe analyze which ones list drupal/ai as a dependency in their composer.json?</li> <li>Nick Opris: <a href="https://packagist.org/packages/list.json?vendor=drupal">https://packagist.org/packages/list.json?vendor=drupal</a> Shouldn't drupal/ai come up here? (edited)</li> <li>valthebald: no, because drupal uses another repository (<a href="https://packages.drupal.org/8">https://packages.drupal.org/8</a>)</li> <li>yautja_cetanu (Jamie): The diagram you made Nick. Might be worth posting it somewhere. I was thinking we should do something like this:</li> <li>yautja_cetanu (Jamie): So instead of "AI Providers" being a node in the diagram. Have it a lightly coloured (and from an aethetic point of view the slightly messy borders is nice) spacce around the AI provider modules to show they are all AI providers.</li> <li>yautja_cetanu (Jamie): There could be a point in the middle for them to all come off so they arn't all from the AI core module</li> <li>yautja_cetanu (Jamie): And then we can collect things thatr are linked to "Automators" (As there are a ton of them) in once place, things linked to Agents and Chat in one place and maybe Search in another</li> <li>yautja_cetanu (Jamie): Search and chat overlap so we could have a ven diagram where the colours mix?</li> <li>Nick Opris: My main point is that it needs to update programmatically. Given the long list we already have it will be hard to maintain this over time if the only way to make it is manually.</li> <li>yautja_cetanu (Jamie): yeah ok</li> <li>yautja_cetanu (Jamie): We can do the above somewhat automatically by tagging each of the modules with the thing that is the background colour</li> <li>valthebald: normally, if module maintainers associate the module with certain ecosystem, it should be automatically listed</li> <li>Nick Opris: we can look at dependencies but it may not always be exact</li> </ul></li> <li>yautja_cetanu (Jamie): 5️⃣ General Updates from me</li> <li>yautja_cetanu (Jamie): Looking to really push this stuff with function calling and actions. My dream is one where:We have a UI that allows you to create an Agent by calling it something, writing a prompt. Selecting the tools.One special tool will be "Handoffs" where basically it can call another agent and ask it to do something.You can then create a "Swarm" of agents. An initial Triage Agent that then has tools or agents to pass things off to.I want to see minikanban upgraded to use the AI module. (D11 will take a little time but d10 is fine for now).You can then create your "Swarm" in the minikanban UI and maybe click a button to see what agents are available for that swarm.This means you can create all your agents and swarm and then fire them off in the minikanban and see them go.I want to see "Review" agents so that Agents can loop. They do something, get it reviewed and if it doesn't pass review they do it again. They can also pass it on to humans to review, comment on and then pass it on.The list of tools will be "Resources" which provide it informatioin from search, files, the web or Drupal Contexts.The other kind of Tool will be an action tool and you can select from Drupal Actions and ECA actions.This is my dream :)</li> Participants: thejimbirch, Marcus Johansson, valthebald, yautja_cetanu (Jamie), Jayjitraj jadeja, Joonas Meriläinen, michaellander, Jasper Lammens, Scott Euser, Nick Opris

issue