AI Media Discovery: Store and retrieve extended media data in vector database
>>> [!note] Migrated issue <!-- Drupal.org comment --> <!-- Migrated from issue #3545342. --> Reported by: [tonypaulbarker](https://www.drupal.org/user/807484) >>> <h3 id="summary-problem-motivation">Problem/Motivation</h3> <p>We can potentially capture and use extended data about media items, including: subjects and objects of the image; location information; contextual information from content usage; metrics on mood such as happiness and sadness; dominant colour information; lighting information.</p> <p>With so much potential data it makes sense not to overwhelm editors and adversely affect performance by storing this data in regular Drupal fields, so vector databases are a likely approach.</p> <h3 id="summary-proposed-resolution">Proposed resolution</h3> <p>Make it easy for developers creating Drupal AI tools to make use of extended data about media items by figuring out, developing, reviewing and documenting approaches. </p> <p>Support a variety of data capture methods including JavaScript scanners, AI tools, imported data, EXIF data and manual input.</p> <p>Support media find-ability and search-ability.</p> <h3 id="summary-remaining-tasks">Remaining tasks</h3> <p>- List and provide examples of scenarios<br> - List and provide examples of technologies and tools<br> - Figure out and document how to configure things to achieve the scenarios with tools that already exist<br> - Describe potentially useful tools yet to be developed<br> - Validate the approaches with community review </p> > Related issue: [Issue #3541825](https://www.drupal.org/node/3541825)
issue