Dynamically load Tokenizer after selecting Embedding Engine
>>> [!note] Migrated issue <!-- Drupal.org comment --> <!-- Migrated from issue #3477973. --> Reported by: [scott_euser](https://www.drupal.org/user/3267594) Related to !141 >>> <h3 id="summary-problem-motivation">Problem/Motivation</h3> <p>Tokenizer can often be determined by the Embedding Engine chosen.</p> <h4 id="summary-steps-reproduce">Steps to reproduce</h4> <p>Currently have to set both Embedding Engine and Tokenizer</p> <h3 id="summary-proposed-resolution">Proposed resolution</h3> <p>Select the Tokenizer automatically once Embedding Engine is selected (subform) where possible.<br> Where not possible, the user must still choose.<br> This should be done once <span class="drupalorg-gitlab-issue-link project-issue-status-info project-issue-status-7"><a href="https://www.drupal.org/project/ai/issues/3471759" title="Status: Closed (fixed)">#3471759: Search API Index fields need more user control, UI should be updated to make it clearer how the embedding content is prepared</a></span> is merged to avoid merge conflicts.</p> <h3 id="summary-remaining-tasks">Remaining tasks</h3> <p>MR</p> <h3 id="summary-ui-changes">User interface changes</h3> <p>Tokenizer attempted to be auto-selected based on Embedding Engine</p> <h3 id="summary-api-changes">API changes</h3> <p>N/A</p> <h3 id="summary-data-model-changes">Data model changes</h3> <p>N/A</p>
issue