[Meta] Creating a process to creating openai compatible providers from metadata file
>>> [!note] Migrated issue
<!-- Drupal.org comment -->
<!-- Migrated from issue #3548889. -->
Reported by: [catia_penas](https://www.drupal.org/user/3725216)
>>>
<p>[Tracker]<br>
<strong>Update Summary: </strong>Creating a process to creating openai compatible providers from metadata file<br>
<strong>Short Description: </strong>Creating a process to creating openai compatible providers from metadata file<br>
<strong>Check-in Date: </strong>MM/DD/YYYY<br>
<em>Metadata is used by the <a href="https://www.drupalstarforge.ai/" title="AI Tracker">AI Tracker.</a> Docs and additional fields <a href="https://www.drupalstarforge.ai/ai-dashboard/docs" title="AI Issue Tracker Documentation">here</a>.</em><br>
[/Tracker]</p>
<h3 id="summary-problem-motivation">Problem/Motivation</h3>
<p><strong>Positives of current situation</strong><br>
Having Providers out of AI module is good for the fact that many agencies will only want to support one provider and won't want to have everything bundled.<br>
In 1.2 we already have pulled the openai sdk into core. This means for many providers (fireworks, litelmm, olama) we only need simple config in order to get it working, almost no code.</p>
<p><strong>Problems</strong><br>
However not having providers in core is confusing for newbies.<br>
Having to maintain a ton of modules for each provider is getting unmanageable.<br>
MANY providers use the OpenAI SDK and almost all the code of OpenAI, we can require it but then you have a wierd situation where the OpenAI provider is installed and visible when I don't want to use it.</p>
<h4 id="summary-steps-reproduce">Steps to reproduce (required for bugs, but not feature requests)</h4>
<p>Please provide information like AI modules enabled, which AI provider, browser, etc.</p>
<h3 id="summary-proposed-resolution">Proposed resolution</h3>
<p><strong>Solution:</strong><br>
We could maintain a simple file inside the AI module that stores all the config needed for all the providers (Model metadata like context,<br>
A UI for setting up "OpenAI compatible providers" which would make that provider appear in the list. (But I won't see all the other providers I could use, unless I go through the setup again).</p>
<h3 id="summary-remaining-tasks">Remaining tasks</h3>
<h3>Optional: Other details as applicable (e.g., User interface changes, API changes, Data model changes)</h3>
issue