Tags

Branch force pushed by scotteuser at 2024-10-17T08:11:03+00:00, 3481376-combined-search-results moved from this tag to c8b64ef83b0f0e64f321cbab9cc769cff85c42b9

Features:
Add chunker checker to AI Search (AI Search)
Add generic interface to override and add models + Model metadata to provider (AI Core)
Make RAG Action of full entity a single chat call instead of multiple (AI Search)
Provide a mechanism to combine vector search with traditional search (AI Search)
Allow change to View Mode in RAG Action (AI Search)
Add pre-chunk modification method in Search API AI (AI Search)
Provide integration with Pinecone (AI Search)
Implement chat with image for ai_automators (AI Automators)
Add a GUI for external moderation (AI External Moderation)
Add streaming support for Mistral (Mistral Provider)
Add disposable Automator bundles (AI Automators)
AI API Explorer for Translate Text (AI API Explorer)
Add image Chat input possibility with Ollama (Ollama Provider)
Add log pruning to AI Logging (AI Logging)
[ai_translate] more flexibility (AI Translate)
Translation operator type (AI Core)
Make AI Logs Entity Bundleable and Fieldable (AI Logging)
Consider moving sub-module specific composer.json requirements into suggest rather than require (AI Core)
Reintroduce the 'Reformat' Function from OpenAI Module into AI CKEditor (AI CKEditor)
Tasks/Improvements:
Add provider list documentation (Documentation)
Check OpenAI connection on setup (OpenAI Provider)
Add documentation for AI Search module (Documentation)
Allow Milvus VDB Provider to filter on meta data (AI Search)
Change how users select `tokenizer chat model` on AI Search / Search API server (AI Search)
Document how you receive streaming vs none streaming output (Documentation)
Search API Index fields need more user control, UI should be updated to make it clearer how the embedding content is prepared (AI Search)
Chunked embeddings should have a unique ID (AI Search)
Make AI Assistant Form more user friendly (AI Assistants API)
Validate that the Milvus metric type matches that of the collection when using Milvus (AI Search)
Minor Search AI fixes (AI Search)
Add a way to get the chat system role (AI Core)
Add System Role to chat logging (AI Logging)
Update config schema for the AI settings (AI Core)
Allow Pinecone VDB Provider to filter on meta data (AI Search)
Refactor Search API integration to pass more of the work to the VBD Provider (AI Search)
Document Translation Type (Documentation)
Add a global JSON decoder for both streaming and none streaming responses. (AI Core)
Document setChatSystemRole & getChatSystemRole (Documentation)
Rename data name to ai_automators (Documentation)
Switch to .cspell-project-words.txt to reduce merge conflicts (AI Core)
AI Assistant full entity should convert to markdown for the LLM (AI Assistants API)
Move AI Assistant to use JSON service (AI Assistants API)
Move AI Automators to use JSON service (AI Automators)
Switch to Json::decode() from Drupal core (AI Core)
Remove default model selection, make the user choose (or provide a sensible default) (AI Core)
Update hook for Search AI refactoring (AI Search)
Add Search API details about Zilliz/Milvus status on the Index View page (AI Search)
Add Readme (Documentation)
Write documentation for AI CKEditor (Documentation)
Add so model settings is actually overridable (AI Core)
Ai Assistants Should be experimental (AI Assistants API)
Add common models and dimensions for Embeddings info (AI Core)
Bugs:
Combined vector & traditional search should only allow processor plugin where applicable (AI Search)
ai_external_moderation: ModeratePreRequestEventSubscriber TypeError (AI External Moderation)
Class Drupal\ai_translate\Drush\AiTranslateCommands extends unknown class Drush\Commands\DrushCommands (DevOps)
Defaults for extraAdvancedFormFields in taxonomy.php (text manipulation and find similar tags) (AI Automators)
Fix more references to metadata in code that is actually contextual content (AI Search)
AI CK Editor sparkle should be black instead of yellow for contrast (accessibility) (AI CKEditor)
Ai Translate - translateContent (AI Translate)
Saving index pages other than Fields wipes the Fields indexing options (AI Search)
AI translate settings form does not save entity reference settings (AI Translate)
CK Editor AI Assistant throws Bad Request error when using AWS Bedrock Provider (AI CKEditor)
AI Chatbot causes forms to not send. (AI Chatbot)
AI Assistants have to much context (AI Assistants API)
[error_message] does not get filled (AI Assistants API)
Fix issue with embedding strategy configuration (AI Search)
Ai Automators doesn't works with Queue/cron (AI Automators)
nvalidArgumentException: "type" is an invalid render array key. (Huggingface Provider)
Use natural instead of neutral (OpenAI Provider)
Zilliz queries get 403. (Milvus VDB Provider)
Problem with translation of multiple formatter fields turning HTML into string (AI Translate)
AI Assistant fails when pure JSON is returned (AI Assistants API)
Vector DB Explorer, show results on wrong place in Gin (AI API Explorer)
AI Automators LLM Model doesn't show (AI Automators)
[ai_translate] Error: Call to a member function hasTranslation() on null (AI Translate)
RAG doesn't work without session on (AI Assistants API)
isZilliz check in MilvusV2 is not correct (Milvus VDB Provider)
Avoid crashing the AI settings page if the default provider is not fully configured (AI Core)
AI Search Few Shot Learning is wrong (AI Search)
When adding assistant the provider config form is empty resulting to an error (AI Assistants API)
Log cron deletion options should not require auto-logging enabled (AI Logging)
Deprecated function: explode(): Passing null to parameter #2 ($string) of type string is deprecated in Drupal\ai_translate\Form\AiTranslateForm->buildForm() (line 112 of AiTranslateForm.php (AI Translate)
Warning : Undefined array key "indexing_options" dans Drupal\ai_search\Plugin\EmbeddingStrategy\EmbeddingBase->buildBaseMetadata() (AI Search)

- Issue #3474442 by marcus_johansson: Latest dev build gives haystack error (aad748f) by Marcus Johansson on 2024-09-16
- Issue #3474662 by marcus_johansson: AI Chatbot is hidden behind Gin Sidebar (0aca34b) by Marcus Johansson on 2024-09-16
- Issue #3474622 by marcus_johansson: Make AI Assistant Form more user friendly (dfaccc1) by Marcus Johansson on 2024-09-16
- Adding basic README and beginning of structure for docs (8dcaee8) by Jerad Bitner on 2024-09-14
- Issue #3474256 by marcus_johansson: Fix PHPStan issues (3c91124) by Marcus Johansson on 2024-09-14
- Fix phpcs/phpstan issues in ai_search and vdb_providers (30db503) by Scott Euser on 2024-09-13
- Issue #3474233 by scott_euser: Leaving maximum chunk size blank results in fatal errors (0b44647) by Scott Euser on 2024-09-13
- Fix phpcs and grumphp (2a4c64b) by Marcus Johansson on 2024-09-13
- Issue #3474186 by marcus_johansson: Fix Stylelint issues (1f258b5) by Marcus Johansson on 2024-09-13
- Functional testing broken test (a9a1e14) by Marcus Johansson on 2024-09-13
- Issue #3474160 by marcus_johansson: Get CSpell tests working (2779bf6) by Marcus Johansson on 2024-09-13
- Resolve #3466972 "Default model support in ai_ckeditor and ai_content" (48076ca) by wouters_f on 2024-09-13
- Issue #3474109 by marcus_johansson: Make o1 models available in OpenAI Provider (6d26f73) by Marcus Johansson on 2024-09-13
- Tagged messages and events on AI Assistant (b33ef3f) by Marcus Johansson on 2024-09-13
- Issue #3473809: Milvus provider doesn't respect selected database name (74e3c6b) by Artem  Dmitriiev on 2024-09-12
- Suggest taxonomy option to use existing vocabulary. (c89438f) by Stathis [Efstathios] Papadopoulos on 2024-09-12
- Resolve #3464024 "Aitranslate reference" (28135ef) by Valery Lourie on 2024-09-12
- Resolve #3472421 "Ckeditor improvements" (0cba60f) by wouters_f on 2024-09-11
- Remove moderation test, should be added later (b05b9e0) by Marcus Johansson on 2024-09-11
- Issue #3472525 by marcus_johansson, vivek panicker: Improvement to Chatbot (227d62d) by Marcus Johansson on 2024-09-11
- Issue #3473142: Removed redundant code. (3686200) by vivekpan27 on 2024-09-09
- Issue #3473378: The user profile image does not work in the Chatbot (1726ca8) by Marcus Johansson on 2024-09-10
- Issue #3473378: The user profile image does not work in the Chatbot (b58b9de) by Marcus Johansson on 2024-09-10
- Allow the bot_image to be configured in the AI Chatbot block. (c8e6c91) by Ronald te Brake on 2024-09-10
- Not immutable assistants in assistants api (1036da2) by Marcus Johansson on 2024-09-10
- Ensure we take both zilliz base urls into account when determining if we are running on zilliz. (fe8e1c6) by Ronald te Brake on 2024-09-10
- Issue #3471275 by ultimike, marcus_johansson: "Advanced" Automated input mode not available when Token module is enabled (a94be3e) by Marcus Johansson on 2024-09-09
- Update the correct input name for field the RagAction should check on. (f4a3f55) by Ronald te Brake on 2024-09-08
- Issue #3472578 by marcus_johansson: Drupal Core 10.2 compatibility issue (7aa50a1) by Marcus Johansson on 2024-09-06
- Issue #3472578: Drupal Core 10.2 compatibility issue (81625f0) by Marcus Johansson on 2024-09-06
- Issue #3472394 by marcus_johansson: Complex search queries are not supported (ad98524) by Marcus Johansson on 2024-09-05
- Issue #3472525 by marcus_johansson, vivek panicker: Improvement to Chatbot (9b3b65a) by Marcus Johansson on 2024-09-06
- Context added to the AI Assistant (95a810b) by Marcus Johansson on 2024-09-06
- Issue #3472270 by marcus_johansson: AI Chatbot causes forms to not send (b150798) by Marcus Johansson on 2024-09-06
- Issue #3472510 by marcus_johansson: Unneccesary validation call in Milvus Provider (164801c) by Marcus Johansson on 2024-09-06
- Issue #3472270: AI Chatbot causes forms to not send (b19d1e9) by Marcus Johansson on 2024-09-05
- Issue #3471888 by marcus_johansson: Image Classification Field Validator (0286240) by Marcus Johansson on 2024-09-03
- Issue #3456770 by marcus_johansson: Discuss: Interface suggestion for image... (fb7c426) by Marcus Johansson on 2024-09-03
- Issue #3470766 by marcus_johansson: Getting white screen crash from missing dependency (2f6d0d8) by Marcus Johansson on 2024-09-03
- AI sub module :ECA support (ai_eca) (ce6539b) by Jasper Lammens on 2024-09-03
- Update tiktoken fallback (b665ff6) by Scott Euser on 2024-09-03
- Issue #3471259 by marcus_johansson: Vector dimension mismatch when using Zilliz (d360a6c) by Marcus Johansson on 2024-09-02
- Better error messages (c0c371e) by Marcus Johansson on 2024-09-02
- Let providers set defaults (2db5efa) by Marcus Johansson on 2024-09-02
- Updated Chatbot schema (10e77cb) by Marcus Johansson on 2024-08-30
- Updated AI Assistant schema (92d5f22) by Marcus Johansson on 2024-08-30
- Updated AI Assistant schema (adcc9cc) by Marcus Johansson on 2024-08-30
- Issue #3471155 by torfj: API explorer admin list page has incorrect title (ca2172e) by Tor F. Jacobsen on 2024-08-30
- Send the messages to the plugin and move the RAG plugin to be in AI Search (c8070d2) by Marcus Johansson on 2024-08-29
- Make sure threading works on AI Assistant (5bf9ea4) by Marcus Johansson on 2024-08-28
- Assistant api threading history (8ca690b) by Marcus Johansson on 2024-08-28
- Graceful fallback on Ollama and LMStudio (73b3728) by Marcus Johansson on 2024-08-27
- Normalize system role (77f9c10) by Marcus Johansson on 2024-08-27
- Issue #3470284 by marcus_johansson: Allow multiple formhelper elements (0ba64a2) by Marcus Johansson on 2024-08-26
- Issue #3467572 by marcus_johansson: Error handling of missing environment variables (caee0d0) by Marcus Johansson on 2024-08-26
- Issue #3467572 by marcus_johansson: Error handling of missing environment variables (b044e4b) by Marcus Johansson on 2024-08-26
- Issue #3470030 by bryanmanalo: When adding assistant the provider config form is empty resulting to an error (2146e29) by Marcus Johansson on 2024-08-26
- Issue #3469278 by scott_euser, seogow: Zero 'Minimum chunk overlap' causes Typed property not initialized (0a410cf) by Scott Euser on 2024-08-26
- Issue #3470180 by kevinquillen: Move StringTranslationTrait from plugins to AiCKEditorPluginBase (7cfa7a4) by Kevin Quillen on 2024-08-26
- Kernel testing (c16ccbb) by Marcus Johansson on 2024-08-23
- Issue #3469178 by marcus_johansson: Add provider and model feature flags for filtering (5487628) by Marcus Johansson on 2024-08-23
- Add a method to get the module name of a provider (c5d8960) by Marcus Johansson on 2024-08-22
- Fix the dates on the Anthropic models (6afe5c4) by Marcus Johansson on 2024-08-22
- Remove default warning message (6d169bf) by Marcus Johansson on 2024-08-21
- Issue #3469110 by marcus_johansson: Vision models in Anthropic (e8fe9ef) by Marcus Johansson on 2024-08-20
- Issue #3469112 by marcus_johansson: Max tokens should have default value in Anthropic when not given (6b70602) by Marcus Johansson on 2024-08-20
- Issue #3467572 by marcus_johansson: Error handling of missing environment variables (4f5d7b0) by Marcus Johansson on 2024-08-20
- Issue #3465010 by kevinquillen, scott_euser, marcus_johansson: [META] Implement Streamed responses in CKEditor plugins (160fe07) by Kevin Quillen on 2024-08-19
- Automators ux (c49132b) by Marcus Johansson on 2024-08-15
- Configurable translation prompt (44029a1) by Valery Lourie on 2024-08-15
- Allow setting default values for dimension size (5c722e3) by Marcus Johansson on 2024-08-08
- Allow setting default values for dimension size (18dd0fd) by Marcus Johansson on 2024-08-08
- Issue #3466797 by Marcus_Johansson: Tiktoken does not support every model (3068d86) by Marcus Johansson on 2024-08-08
- Remove dependency on Milvus library (734ee26) by Marcus Johansson on 2024-08-07
- Drupal 10.2 & PHP 8.1 with own Milvus client (a605e01) by Marcus Johansson on 2024-08-07
- Issue #3465979 by Marcus_Johansson: Contextualize the AI Assistant (04f4aab) by Marcus Johansson on 2024-08-05

Fix for AI Assistants render service

* First AI Search
* Only store the highest score of an result for entities
* Mixed message on vectorSearch and querySearch on thjeAiVdbProviderInterface
* Make more embedding strategy options configurable
* Refactor embedding strategies to be able to extend easier
* Make Vector Search Method Configurable?
* Remove and trim the output in the AI Translate module
* Create a generic plugin layer for CKEditor
* Add access check and iterator logic into SearchApiAiSearchBackend
* Listing pages of provider and AI Logging doesn't show the right listing
* Prompt output doesn't work in logging
* Add new CKEditor plugins to the drop down button in CKEditor toolbar
* Create Entity Tab with visual Automators for an entity
* Delete backend should delete Milvus collection
* Small Zilliz Bugs
* Adding host with slash in the end breaks everything
* Document how to run tests in Milvus dependency
* Error when adding AI Assistant without default provider set in AI Settings
* Add warning message to configure default operation type settings.
* Add access check and iterator logic into SearchApiAiSearchBackend

Release notes
* First Version of AI Automator
* Embeddings should allow to specify the number of dimensions
* Image to Video Operation Type
* Move the ECA processor into the project and move up to ECA 2.0
* Code suggestion for text-to-image is old in the explorer
* Base64 response does not work on OpenAI with normalizers on text-to-image
* Refactor all files to use generictype files
* Garbage Cleaning Configs
* Add Speech-to-Speech explorer
* Add Audio to Audio Explorer
* Remove stream parameter from normal chat and add streamChat operation type.
* Todo: Audio to Audio operator type
* Add Speech-to-Speech operation type
* Port openai_content to ai module
* Generic AI CKEditor Plugin
* ai translate (ai_translate) submodule
* ai_validations for smart text and image validation
* LLM modules ajax fails when Token module is missing.
* Switch Custom Field descriptions fields to textarea
* Remove Install warning message about missing automators
* Fix phpcs issues before alpha4
* Set up experimental modules
* Discussion: Streaming Input/Output
* Move to embeddings to ai provider and allow to select the embeddings model when embedding a field. Move to embeddings to ai provider and allow to select the embeddings model when embedding a field.

New Providers

New design and initial bugs

Initial release of the AI module!