Hallucinated values for tool calls
>>> [!note] Migrated issue
<!-- Drupal.org comment -->
<!-- Migrated from issue #3584723. -->
Reported by: [jan kellermann](https://www.drupal.org/user/371731)
>>>
<p>[Tracker]<br>
<strong>Update Summary: </strong>[One-line status update for stakeholders]<br>
<strong>Short Description: </strong>[One-line issue summary for stakeholders]<br>
<strong>Check-in Date: </strong>MM/DD/YYYY<br>
<em>Metadata is used by the <a href="https://www.drupalstarforge.ai/" title="AI Tracker">AI Tracker.</a> Docs and additional fields <a href="https://www.drupalstarforge.ai/ai-dashboard/docs" title="AI Issue Tracker Documentation">here</a>.</em><br>
[/Tracker]</p>
<h3 id="summary-problem-motivation">Problem/Motivation</h3>
<p>We use an assistant for a chat bot and have added several tools to the associated agent. The tools include a description of the context variables in “context_definition.” However, we regularly receive incorrect variables from the tool's LLM (we've tested several) when calling the tools (e.g., ‘date’ instead of “from”):<br>
<code>The chatbot had an error: The date context is not a valid context.</code><br>
What could be the cause? What is the best way to get valid results from LLM?</p>
<p>And second: When we clear the cache (drush cr) and repeat the query or start a new conversation, it keeps failing at the same point without even sending a new request to the provider. Which cache needs to be cleared here?</p>
<p>Thank you in advance.</p>
issue