Regression: setting a parameter empty class breaks certain models in LiteLLM (#3572765) · Issues · project / ai

Regression: setting a parameter empty class breaks certain models in LiteLLM

>>> [!note] Migrated issue   Reported by: [marcus_johansson](https://www.drupal.org/user/385947) Related to !1179 >>> [Tracker] Update Summary: [One-line status update for stakeholders] Short Description: [One-line issue summary for stakeholders] Check-in Date: MM/DD/YYYY Metadata is used by the <a href="https://www.drupalstarforge.ai/" title="AI Tracker">AI Tracker.</a> Docs and additional fields <a href="https://www.drupalstarforge.ai/ai-dashboard/docs" title="AI Issue Tracker Documentation">here</a>. [/Tracker] <h3 id="summary-problem-motivation">Problem/Motivation</h3> In <a href="https://www.drupal.org/project/ai/issues/3567784" title="Status: Closed (fixed)">#3567784: Tools Function Input should give back an empty json schema skeleton</a> we introduced and fixed a bug where the default parameters where not following proper standards. This caused issues in the Mistral client, Mistral on LiteLLM and Ollama for certain models. Even if there was thourough testing, we did not see that different models in LiteLLM doesn't work the same. This fix seems to have caused regression on Claude Bedrock models when using LiteLLM. It gives a validation error. The idea was to move parameter less functions from: <pre>{   "name": "reindex_content",   "description": "Rebuilds the site search index.",   "parameters": {     "type": "object",     "additionalProperties": false   } }</pre>to <pre>{   "name": "reindex_content",   "description": "Rebuilds the site search index.",   "parameters": {     "type": "object",     "properties": {},     "additionalProperties": false   } }</pre>This was introduced in 1.2.6 and caused this regression. Its actually not following correct <a href="https://community.openai.com/t/on-the-function-calling-what-about-if-i-have-no-parameter-to-call/516876/4">standards</a>, but instead the solution should be <pre>{   "name": "reindex_content",   "description": "Rebuilds the site search index.",   "parameters": {     "type": "object",     "properties": {},     "required": []   } }</pre>However this breaks certain models (Mistral) from the happy path, when there are parameters. @narendrar suggested this: <pre>{   "name": "reindex_content",   "description": "Rebuilds the site search index.",   "parameters": null }</pre>We have tested that so far with LiteLLM (mistral, claude), OpenAI, Anthropic, Ollama (llama3.1) and Mistral (mistral-medium) and it seems to work well in both parameter function and parameter less function. <h4 id="summary-steps-reproduce">Steps to reproduce (required for bugs, but not feature requests)</h4> Setup LiteLLM with Claude (you can use Amazee) In the AI Test module there is a parameter less trigger function. Try to use that, it will give back an exception. <h3 id="summary-proposed-resolution">Proposed resolution</h3> Change to null instead of stdClass. <h3 id="summary-remaining-tasks">Remaining tasks</h3> <h3>Optional: Other details as applicable (e.g., User interface changes, API changes, Data model changes)</h3> <h3 id="summary-ai-usage">AI usage (if applicable)</h3> [ ] AI Assisted Issue This issue was generated with AI assistance, but was reviewed and refined by the creator. [ ] AI Assisted Code This code was mainly generated by a human, with AI autocompleting or parts AI generated, but under full human supervision. [ ] AI Generated Code This code was mainly generated by an AI with human guidance, and reviewed, tested, and refined by a human. [ ] Vibe Coded This code was generated by an AI and has only been functionally tested.

issue