task: #3634633 Bring the functional tests of the released Varbase recipes into the Varbase functional testing suite

Rajab Natshahrequested to merge
issue/varbase_project-3634633:3634633-bring-the-functional into 11.0.x

Brings the functional tests of the released Varbase recipes into the Varbase functional testing suite on 11.0.x: 164 more scenario runs (327 to 491). Issue: #3634633

  • Folded into 14-ai, 16-eca-workflow-modeler (now in the matrix, it never ran) and 17-search; new 18-events, 19-news, 20-podcasts.
  • Install: a testing site template adds Events, News and Podcasts during the install, the unapplied AI recipes (Readable, SEO, Chatbot, Content Operations, Figma) are applied, test content is seeded from recipes.
  • 33 matrix jobs, slowest 8.6 min. WProofreader is stubbed in every scenario.

Left out: scenarios that call an AI model or vector database (AI Search Base and AI Answers are not applied), the editor AI Assistant toolbar (CI removes the button), one live SoundCloud scenario, and podcasts related and listen-on (their blocks are not placed on any page).

Found on the way: Events, News, Podcasts and the Ask AI pattern fail config validation when applied to an installed site; AI Taxonomy Tagging gives Utility pages a status field with no allowed values.

AI-Generated: Yes

Checkpoints:

  • File an issue
  • Addition/Change/Update/Fix
  • Testing to ensure no regression
  • Automated unit testing coverage
  • Automated functional testing coverage
  • UX/UI designer responsibilities
  • Readability
  • Accessibility
  • Performance
  • Security
  • Developer Documentation
  • User Guide Documentation
  • Reviewed by human
  • Code review by maintainers
  • Full testing and approval
  • Credit contributors
  • Review with the product owner
  • Release notes snippet
  • Release

🤖 Generated with Claude Code

Edited by Rajab Natshah

Merge request reports