>>> [!note] Migrated issue <!-- Drupal.org comment --> <!-- Migrated from issue #3462711. --> Reported by: [scott_euser](https://www.drupal.org/user/3267594) >>> <h3 id="summary-problem-motivation">Problem/Motivation</h3> <p>Tokenizer chunking subsequent chunks are not roughly equivalent size as shown running </p> <pre>phpunit -c core/phpunit.xml modules/contrib/ai/tests/src/Kernel/Utility/TextChunkerTest.php</pre><h4 id="summary-steps-reproduce">Steps to reproduce</h4> <p>Check out the tests, first chunk is fine, subsequent chunks are not<br> Probably something going wrong with overlap</p> <h3 id="summary-proposed-resolution">Proposed resolution</h3> <p>Investigate and solve</p> <h3 id="summary-remaining-tasks">Remaining tasks</h3> <p>MR</p> <h3 id="summary-ui-changes">User interface changes</h3> <p>N/A</p> <h3 id="summary-api-changes">API changes</h3> <p>N/A</p> <h3 id="summary-data-model-changes">Data model changes</h3> <p>N/A</p>