Input
What you provide
- A scoring objective and source examples. Reviewer roles and policy.
- Criterion clarity and scoring scale. Approval state.
Models / Rubric Studio
Turn review criteria into a governed scoring standard.
Author versioned criteria and score against a fixed version. Disagreements go to an adjudicator. Every approval keeps its record.
For the evaluation, quality, and safety teams who need grading to agree. We scope each program with your team: the workflow, the review policy, and the evidence it keeps.
SourceScoring objective
StateAdjudication review
- Rubric draftCriterion clarity and scoring scale. Approval state.
- Grade and adjudication recordRubric author, grader, and evaluation owner.
- Published rubric versionA versioned rubric with its grades, adjudications, and approvals.
Decision optionsApprove and activate the rubric version. Revise it as a new draft, or retire it.
Input, work, and output
Work
What happens
- Author the criteria. Score, adjudicate, approve.
- Responsible review: Rubric author, grader, and evaluation owner.
Output
What you receive
- A versioned rubric with its grades, adjudications, and approvals.
- Decision: Approve and activate the rubric version. Revise it as a new draft, or retire it.
Decision flow
The steps from intake to handoff, in order.
01
Scope
A scoring objective and source examples. Reviewer roles and policy.
Rubric draft
02
Operate
Author the criteria. Score, adjudicate, approve.
Grade and adjudication record
03
Review
Criterion clarity and scoring scale. Approval state. Rubric author, grader, and evaluation owner.
Review and decision history
04
Release
A versioned rubric with its grades, adjudications, and approvals.
Published rubric version
What you receive
Turn review criteria into a governed scoring standard. deliverables
- Input
- A scoring objective and source examples. Reviewer roles and policy.Named source and version
- Criteria
- Criterion clarity and scoring scale. Approval state.Rubric draft
- Reviewer
- Rubric author, grader, and evaluation owner.Grade and adjudication record
- Decision
- Approve and activate the rubric version. Revise it as a new draft, or retire it.Who decided, and when
- Output
- A versioned rubric with its grades, adjudications, and approvals.Published rubric version
What the workflow supports
| Outcome | Work | What you receive | Program fit |
|---|---|---|---|
| Advance | The required Rubric Studio checks and review are complete. | Rubric draft, Grade and adjudication record, Published rubric version | Configured to your model versions, evaluation criteria, and review team. |
| Hold | A required check or approval is missing. | What is blocking, and what it needs. | Holds remain active until the regression passes replay and reviewer sign-off. |
| Return for work | The source object or workflow requires correction and another review. | The returned items, their owner, and the review route back. | Corrected items automatically re-enter verification before acceptance. |
Inspect the workflow
See how the workflow moves from input to decision.
Guides
Related reading
Rubric Studio Open: Author and Calibrate AI EvalsAuthor criterion-level AI evaluation rubrics, calibrate reviewer agreement, compare versions and export reproducible local artifacts with Rubric Studio Open.Why Unit Tests Alone Are Not Enough for AI EvaluationCombine deterministic checks, calibrated model judges and human review to evaluate AI quality and make evidence-based release decisions.AI Benchmarks vs Release Gates: What Each Can ProveAI benchmarks compare capability. Workflow evaluations and release gates add local evidence, regression history and approvals. See what each can prove.