Tags

Bug fix #3491390

Fixed validation for schemas.

3485807 Hackaton europa: Flesch Reading Ease (Readability score)
3488356 Chatbot: Resolve JS errors
3489338 generateMediaImageFromFile doesn't prepare the directory
3489343 Add entityTypeManager and a function that creates taxonomy terms in the general helper
3488394 Refactor the Assistants Prompt Configuration
3488576 Chatbot: Historical chats should be rendered with markdown when selected
3490109 Users are unable to find the list of available providers, the deprecated list is confusing
3490194 Create Usage Instructions for the AI Assistant Plugins
3485038 Replace _ with - in paths
3488400 Make it possible to set extradata in preResponseEvent and pass it on
3490261 Module description is unhelpful
3481156 AI API Explorer hardcodes forms that require undeclared dependencies
3491039 Hide deprecated modules from the UI
3488103 Create unique thread id on clear history
3488147 Storing of results should be reset before running, not after
3487491 Need the chatbot to store history when you refresh the page.
3486101 Moderation Operation Type returns unclear data
3487717 Chatbot: Add chat message complete class to allow specific CSS
3487736 [ai_content_suggestions] reworked ai content does not work properly; ux improvements
3487257 Add which user is using the message in the Chatbot template
3487238 Add uid to unique keys on assistants api
3487228 AI Assistant forgets thread_id
3458607 Handle chat history vs reduced context length with sensible defaults
3487176 Remove depracated AI Automator module
3487173 Make AI Assistants more flexible for 3rd party modules

* 3483197 Text format is escaped until (manual) re-save
* 3482302 Content moderation, AI Provider dropdown selection not saved
* 3482760 Placeholder text for AI Assistant provides malformed URLs
* 3482720 Make chatbot toggle session a configuration.
* 3483362 Default providers should depend on operation type
* 3483356 Move out all provider modules to contrib modules
* 3481112 Can't import config because of "missing" module ai_models
* 3463830 [Discussion]What approach should take with name provider modules and automators
* 3475317 Exception: Failed to insert into collection
* 3480518 Create AI CKEditor Automator
* 3482651 Menu items display when there are no configuration items
* 3482633 Make it optional to stream in AI Chatbot
* 3482976 WSOD if the provider is removed in Assistant API
* 3481228 Discourage Search API processors that are meaningless/useless in VDBs
* 3481202 When indexing entity reference fields into the vectors (main or contextual), can we index the label instead of ID?
* 3481408 Support combined search with multiple languages better
* 3481567 Improved CKEditor/Automators
* 3481376 For AI Search combined with database search, results are reordered by new results are not added
* 3481378 Add a more helpful message for 'Server index status'
* 3481232 CKEditor Summarize Option Frequently Returns Original Text Without Summarizing
* 3481184 Hide 'boost' column in indexing field configuration as it makes no sense in vector context
* 3481178 Make 'ignore' in search indexing options make more sense
* 3480726 Document the AI Assistants API and AI Chatbot
* 3481121 Fatal error in AI API Explorer module
* 3480999 Document developing for AI CKeditor
* 3471143 Display formatted output in AI assistant
* 3480762 AI Search does not normalize the embeddings
* 3480325 Add AI Automator Rule for Moderation State
* 3480734 Update to use D11 in Gitlab

Features:
Add chunker checker to AI Search (AI Search)
Add generic interface to override and add models + Model metadata to provider (AI Core)
Make RAG Action of full entity a single chat call instead of multiple (AI Search)
Provide a mechanism to combine vector search with traditional search (AI Search)
Allow change to View Mode in RAG Action (AI Search)
Add pre-chunk modification method in Search API AI (AI Search)
Provide integration with Pinecone (AI Search)
Implement chat with image for ai_automators (AI Automators)
Add a GUI for external moderation (AI External Moderation)
Add streaming support for Mistral (Mistral Provider)
Add disposable Automator bundles (AI Automators)
AI API Explorer for Translate Text (AI API Explorer)
Add image Chat input possibility with Ollama (Ollama Provider)
Add log pruning to AI Logging (AI Logging)
[ai_translate] more flexibility (AI Translate)
Translation operator type (AI Core)
Make AI Logs Entity Bundleable and Fieldable (AI Logging)
Consider moving sub-module specific composer.json requirements into suggest rather than require (AI Core)
Reintroduce the 'Reformat' Function from OpenAI Module into AI CKEditor (AI CKEditor)
Tasks/Improvements:
Add provider list documentation (Documentation)
Check OpenAI connection on setup (OpenAI Provider)
Add documentation for AI Search module (Documentation)
Allow Milvus VDB Provider to filter on meta data (AI Search)
Change how users select `tokenizer chat model` on AI Search / Search API server (AI Search)
Document how you receive streaming vs none streaming output (Documentation)
Search API Index fields need more user control, UI should be updated to make it clearer how the embedding content is prepared (AI Search)
Chunked embeddings should have a unique ID (AI Search)
Make AI Assistant Form more user friendly (AI Assistants API)
Validate that the Milvus metric type matches that of the collection when using Milvus (AI Search)
Minor Search AI fixes (AI Search)
Add a way to get the chat system role (AI Core)
Add System Role to chat logging (AI Logging)
Update config schema for the AI settings (AI Core)
Allow Pinecone VDB Provider to filter on meta data (AI Search)
Refactor Search API integration to pass more of the work to the VBD Provider (AI Search)
Document Translation Type (Documentation)
Add a global JSON decoder for both streaming and none streaming responses. (AI Core)
Document setChatSystemRole & getChatSystemRole (Documentation)
Rename data name to ai_automators (Documentation)
Switch to .cspell-project-words.txt to reduce merge conflicts (AI Core)
AI Assistant full entity should convert to markdown for the LLM (AI Assistants API)
Move AI Assistant to use JSON service (AI Assistants API)
Move AI Automators to use JSON service (AI Automators)
Switch to Json::decode() from Drupal core (AI Core)
Remove default model selection, make the user choose (or provide a sensible default) (AI Core)
Update hook for Search AI refactoring (AI Search)
Add Search API details about Zilliz/Milvus status on the Index View page (AI Search)
Add Readme (Documentation)
Write documentation for AI CKEditor (Documentation)
Add so model settings is actually overridable (AI Core)
Ai Assistants Should be experimental (AI Assistants API)
Add common models and dimensions for Embeddings info (AI Core)
Bugs:
Combined vector & traditional search should only allow processor plugin where applicable (AI Search)
ai_external_moderation: ModeratePreRequestEventSubscriber TypeError (AI External Moderation)
Class Drupal\ai_translate\Drush\AiTranslateCommands extends unknown class Drush\Commands\DrushCommands (DevOps)
Defaults for extraAdvancedFormFields in taxonomy.php (text manipulation and find similar tags) (AI Automators)
Fix more references to metadata in code that is actually contextual content (AI Search)
AI CK Editor sparkle should be black instead of yellow for contrast (accessibility) (AI CKEditor)
Ai Translate - translateContent (AI Translate)
Saving index pages other than Fields wipes the Fields indexing options (AI Search)
AI translate settings form does not save entity reference settings (AI Translate)
CK Editor AI Assistant throws Bad Request error when using AWS Bedrock Provider (AI CKEditor)
AI Chatbot causes forms to not send. (AI Chatbot)
AI Assistants have to much context (AI Assistants API)
[error_message] does not get filled (AI Assistants API)
Fix issue with embedding strategy configuration (AI Search)
Ai Automators doesn't works with Queue/cron (AI Automators)
nvalidArgumentException: "type" is an invalid render array key. (Huggingface Provider)
Use natural instead of neutral (OpenAI Provider)
Zilliz queries get 403. (Milvus VDB Provider)
Problem with translation of multiple formatter fields turning HTML into string (AI Translate)
AI Assistant fails when pure JSON is returned (AI Assistants API)
Vector DB Explorer, show results on wrong place in Gin (AI API Explorer)
AI Automators LLM Model doesn't show (AI Automators)
[ai_translate] Error: Call to a member function hasTranslation() on null (AI Translate)
RAG doesn't work without session on (AI Assistants API)
isZilliz check in MilvusV2 is not correct (Milvus VDB Provider)
Avoid crashing the AI settings page if the default provider is not fully configured (AI Core)
AI Search Few Shot Learning is wrong (AI Search)
When adding assistant the provider config form is empty resulting to an error (AI Assistants API)
Log cron deletion options should not require auto-logging enabled (AI Logging)
Deprecated function: explode(): Passing null to parameter #2 ($string) of type string is deprecated in Drupal\ai_translate\Form\AiTranslateForm->buildForm() (line 112 of AiTranslateForm.php (AI Translate)
Warning : Undefined array key "indexing_options" dans Drupal\ai_search\Plugin\EmbeddingStrategy\EmbeddingBase->buildBaseMetadata() (AI Search)

- Issue #3474442 by marcus_johansson: Latest dev build gives haystack error (aad748f) by Marcus Johansson on 2024-09-16
- Issue #3474662 by marcus_johansson: AI Chatbot is hidden behind Gin Sidebar (0aca34b) by Marcus Johansson on 2024-09-16
- Issue #3474622 by marcus_johansson: Make AI Assistant Form more user friendly (dfaccc1) by Marcus Johansson on 2024-09-16
- Adding basic README and beginning of structure for docs (8dcaee8) by Jerad Bitner on 2024-09-14
- Issue #3474256 by marcus_johansson: Fix PHPStan issues (3c91124) by Marcus Johansson on 2024-09-14
- Fix phpcs/phpstan issues in ai_search and vdb_providers (30db503) by Scott Euser on 2024-09-13
- Issue #3474233 by scott_euser: Leaving maximum chunk size blank results in fatal errors (0b44647) by Scott Euser on 2024-09-13
- Fix phpcs and grumphp (2a4c64b) by Marcus Johansson on 2024-09-13
- Issue #3474186 by marcus_johansson: Fix Stylelint issues (1f258b5) by Marcus Johansson on 2024-09-13
- Functional testing broken test (a9a1e14) by Marcus Johansson on 2024-09-13
- Issue #3474160 by marcus_johansson: Get CSpell tests working (2779bf6) by Marcus Johansson on 2024-09-13
- Resolve #3466972 "Default model support in ai_ckeditor and ai_content" (48076ca) by wouters_f on 2024-09-13
- Issue #3474109 by marcus_johansson: Make o1 models available in OpenAI Provider (6d26f73) by Marcus Johansson on 2024-09-13
- Tagged messages and events on AI Assistant (b33ef3f) by Marcus Johansson on 2024-09-13
- Issue #3473809: Milvus provider doesn't respect selected database name (74e3c6b) by Artem  Dmitriiev on 2024-09-12
- Suggest taxonomy option to use existing vocabulary. (c89438f) by Stathis [Efstathios] Papadopoulos on 2024-09-12
- Resolve #3464024 "Aitranslate reference" (28135ef) by Valery Lourie on 2024-09-12
- Resolve #3472421 "Ckeditor improvements" (0cba60f) by wouters_f on 2024-09-11
- Remove moderation test, should be added later (b05b9e0) by Marcus Johansson on 2024-09-11
- Issue #3472525 by marcus_johansson, vivek panicker: Improvement to Chatbot (227d62d) by Marcus Johansson on 2024-09-11
- Issue #3473142: Removed redundant code. (3686200) by vivekpan27 on 2024-09-09
- Issue #3473378: The user profile image does not work in the Chatbot (1726ca8) by Marcus Johansson on 2024-09-10
- Issue #3473378: The user profile image does not work in the Chatbot (b58b9de) by Marcus Johansson on 2024-09-10
- Allow the bot_image to be configured in the AI Chatbot block. (c8e6c91) by Ronald te Brake on 2024-09-10
- Not immutable assistants in assistants api (1036da2) by Marcus Johansson on 2024-09-10
- Ensure we take both zilliz base urls into account when determining if we are running on zilliz. (fe8e1c6) by Ronald te Brake on 2024-09-10
- Issue #3471275 by ultimike, marcus_johansson: "Advanced" Automated input mode not available when Token module is enabled (a94be3e) by Marcus Johansson on 2024-09-09
- Update the correct input name for field the RagAction should check on. (f4a3f55) by Ronald te Brake on 2024-09-08
- Issue #3472578 by marcus_johansson: Drupal Core 10.2 compatibility issue (7aa50a1) by Marcus Johansson on 2024-09-06
- Issue #3472578: Drupal Core 10.2 compatibility issue (81625f0) by Marcus Johansson on 2024-09-06
- Issue #3472394 by marcus_johansson: Complex search queries are not supported (ad98524) by Marcus Johansson on 2024-09-05
- Issue #3472525 by marcus_johansson, vivek panicker: Improvement to Chatbot (9b3b65a) by Marcus Johansson on 2024-09-06
- Context added to the AI Assistant (95a810b) by Marcus Johansson on 2024-09-06
- Issue #3472270 by marcus_johansson: AI Chatbot causes forms to not send (b150798) by Marcus Johansson on 2024-09-06
- Issue #3472510 by marcus_johansson: Unneccesary validation call in Milvus Provider (164801c) by Marcus Johansson on 2024-09-06
- Issue #3472270: AI Chatbot causes forms to not send (b19d1e9) by Marcus Johansson on 2024-09-05
- Issue #3471888 by marcus_johansson: Image Classification Field Validator (0286240) by Marcus Johansson on 2024-09-03
- Issue #3456770 by marcus_johansson: Discuss: Interface suggestion for image... (fb7c426) by Marcus Johansson on 2024-09-03
- Issue #3470766 by marcus_johansson: Getting white screen crash from missing dependency (2f6d0d8) by Marcus Johansson on 2024-09-03
- AI sub module :ECA support (ai_eca) (ce6539b) by Jasper Lammens on 2024-09-03
- Update tiktoken fallback (b665ff6) by Scott Euser on 2024-09-03
- Issue #3471259 by marcus_johansson: Vector dimension mismatch when using Zilliz (d360a6c) by Marcus Johansson on 2024-09-02
- Better error messages (c0c371e) by Marcus Johansson on 2024-09-02
- Let providers set defaults (2db5efa) by Marcus Johansson on 2024-09-02
- Updated Chatbot schema (10e77cb) by Marcus Johansson on 2024-08-30
- Updated AI Assistant schema (92d5f22) by Marcus Johansson on 2024-08-30
- Updated AI Assistant schema (adcc9cc) by Marcus Johansson on 2024-08-30
- Issue #3471155 by torfj: API explorer admin list page has incorrect title (ca2172e) by Tor F. Jacobsen on 2024-08-30
- Send the messages to the plugin and move the RAG plugin to be in AI Search (c8070d2) by Marcus Johansson on 2024-08-29
- Make sure threading works on AI Assistant (5bf9ea4) by Marcus Johansson on 2024-08-28
- Assistant api threading history (8ca690b) by Marcus Johansson on 2024-08-28
- Graceful fallback on Ollama and LMStudio (73b3728) by Marcus Johansson on 2024-08-27
- Normalize system role (77f9c10) by Marcus Johansson on 2024-08-27
- Issue #3470284 by marcus_johansson: Allow multiple formhelper elements (0ba64a2) by Marcus Johansson on 2024-08-26
- Issue #3467572 by marcus_johansson: Error handling of missing environment variables (caee0d0) by Marcus Johansson on 2024-08-26
- Issue #3467572 by marcus_johansson: Error handling of missing environment variables (b044e4b) by Marcus Johansson on 2024-08-26
- Issue #3470030 by bryanmanalo: When adding assistant the provider config form is empty resulting to an error (2146e29) by Marcus Johansson on 2024-08-26
- Issue #3469278 by scott_euser, seogow: Zero 'Minimum chunk overlap' causes Typed property not initialized (0a410cf) by Scott Euser on 2024-08-26
- Issue #3470180 by kevinquillen: Move StringTranslationTrait from plugins to AiCKEditorPluginBase (7cfa7a4) by Kevin Quillen on 2024-08-26
- Kernel testing (c16ccbb) by Marcus Johansson on 2024-08-23
- Issue #3469178 by marcus_johansson: Add provider and model feature flags for filtering (5487628) by Marcus Johansson on 2024-08-23
- Add a method to get the module name of a provider (c5d8960) by Marcus Johansson on 2024-08-22
- Fix the dates on the Anthropic models (6afe5c4) by Marcus Johansson on 2024-08-22
- Remove default warning message (6d169bf) by Marcus Johansson on 2024-08-21
- Issue #3469110 by marcus_johansson: Vision models in Anthropic (e8fe9ef) by Marcus Johansson on 2024-08-20
- Issue #3469112 by marcus_johansson: Max tokens should have default value in Anthropic when not given (6b70602) by Marcus Johansson on 2024-08-20
- Issue #3467572 by marcus_johansson: Error handling of missing environment variables (4f5d7b0) by Marcus Johansson on 2024-08-20
- Issue #3465010 by kevinquillen, scott_euser, marcus_johansson: [META] Implement Streamed responses in CKEditor plugins (160fe07) by Kevin Quillen on 2024-08-19
- Automators ux (c49132b) by Marcus Johansson on 2024-08-15
- Configurable translation prompt (44029a1) by Valery Lourie on 2024-08-15
- Allow setting default values for dimension size (5c722e3) by Marcus Johansson on 2024-08-08
- Allow setting default values for dimension size (18dd0fd) by Marcus Johansson on 2024-08-08
- Issue #3466797 by Marcus_Johansson: Tiktoken does not support every model (3068d86) by Marcus Johansson on 2024-08-08
- Remove dependency on Milvus library (734ee26) by Marcus Johansson on 2024-08-07
- Drupal 10.2 & PHP 8.1 with own Milvus client (a605e01) by Marcus Johansson on 2024-08-07
- Issue #3465979 by Marcus_Johansson: Contextualize the AI Assistant (04f4aab) by Marcus Johansson on 2024-08-05

Fix for AI Assistants render service

* First AI Search
* Only store the highest score of an result for entities
* Mixed message on vectorSearch and querySearch on thjeAiVdbProviderInterface
* Make more embedding strategy options configurable
* Refactor embedding strategies to be able to extend easier
* Make Vector Search Method Configurable?
* Remove and trim the output in the AI Translate module
* Create a generic plugin layer for CKEditor
* Add access check and iterator logic into SearchApiAiSearchBackend
* Listing pages of provider and AI Logging doesn't show the right listing
* Prompt output doesn't work in logging
* Add new CKEditor plugins to the drop down button in CKEditor toolbar
* Create Entity Tab with visual Automators for an entity
* Delete backend should delete Milvus collection
* Small Zilliz Bugs
* Adding host with slash in the end breaks everything
* Document how to run tests in Milvus dependency
* Error when adding AI Assistant without default provider set in AI Settings
* Add warning message to configure default operation type settings.
* Add access check and iterator logic into SearchApiAiSearchBackend

Release notes
* First Version of AI Automator
* Embeddings should allow to specify the number of dimensions
* Image to Video Operation Type
* Move the ECA processor into the project and move up to ECA 2.0
* Code suggestion for text-to-image is old in the explorer
* Base64 response does not work on OpenAI with normalizers on text-to-image
* Refactor all files to use generictype files
* Garbage Cleaning Configs
* Add Speech-to-Speech explorer
* Add Audio to Audio Explorer
* Remove stream parameter from normal chat and add streamChat operation type.
* Todo: Audio to Audio operator type
* Add Speech-to-Speech operation type
* Port openai_content to ai module
* Generic AI CKEditor Plugin
* ai translate (ai_translate) submodule
* ai_validations for smart text and image validation
* LLM modules ajax fails when Token module is missing.
* Switch Custom Field descriptions fields to textarea
* Remove Install warning message about missing automators
* Fix phpcs issues before alpha4
* Set up experimental modules
* Discussion: Streaming Input/Output
* Move to embeddings to ai provider and allow to select the embeddings model when embedding a field. Move to embeddings to ai provider and allow to select the embeddings model when embedding a field.

New Providers

New design and initial bugs

Initial release of the AI module!