feat(schema): add dataset, rubric, judge JSON Schemas (Layer 1, #3586842) (!5) · Merge requests · project / ai_eval

Layer 1 of the Drupal Eval Commons. Three Draft 2020-12 schemas at schema/ that consumers will validate against:

dataset.schema.json: questions[] with id+input required, optional rubric_ref pointing into rubric registry; additionalProperties:true for domain extensions.
rubric.schema.json: id, version (semver), checks[], scoring with combine enum (all_pass/any_pass/weighted_avg/min/max/median). Eleven discriminated check kinds: must_contain_any, must_not_contain, regex, json_schema, php_lint, markdown_structure, tool_usage, format, fact_match, llm_judge, composite.
judge.schema.json: id, version, template; score_type enum (binary/continuous/levels) with optional validation block carrying TPR/TNR + sample_size + validated_at.

Loader wiring, dev dependency, Drush validate-* commands, and grader plugin executor refactor follow in subsequent commits.

Co-Authored-By: Claude Opus 4.7 noreply@anthropic.com

feat(schema): add dataset, rubric, judge JSON Schemas (Layer 1, #3586842)