Models / AuraQC

Move a quality signal into a reviewed, accountable decision.

Every quality signal carries its reason. The reviewer who claims it records the disposition.

Quality leads triaging annotation risk and reviewer disagreement. We scope each program with your team: the workflow, the review policy, and the evidence it keeps.

Quality caseWorkflow record
SourceFlagged items
StateAssigned review
  1. Signal reasonSeverity, rubric fit, and the reason it was flagged.
  2. Calibration recordThe reviewer who claims the flag.
  3. Disposition historyA reviewed quality case with disposition and retained evidence.
Decision optionsConfirm the flag, reject it, or mark it partly correct.

Input, work, and output

Input

What you provide

  • Quality rules, model signals, and the source items they flagged.
  • Severity, rubric fit, and the reason it was flagged.

Work

What happens

  • Triage the signal. Inspect the context. Resolve the case.
  • Responsible review: The reviewer who claims the flag.

Output

What you receive

  • A reviewed quality case with disposition and retained evidence.
  • Decision: Confirm the flag, reject it, or mark it partly correct.

Decision flow

The steps from intake to handoff, in order.

  1. 01

    Scope

    Quality rules, model signals, and the source items they flagged.

    Signal reason

  2. 02

    Operate

    Triage the signal. Inspect the context. Resolve the case.

    Calibration record

  3. 03

    Review

    Severity, rubric fit, and the reason it was flagged. The reviewer who claims the flag.

    Review and decision history

  4. 04

    Release

    A reviewed quality case with disposition and retained evidence.

    Disposition history

What you receive

Move a quality signal into a reviewed, accountable decision. deliverables

Input
Quality rules, model signals, and the source items they flagged.Named source and version
Criteria
Severity, rubric fit, and the reason it was flagged.Signal reason
Reviewer
The reviewer who claims the flag.Calibration record
Decision
Confirm the flag, reject it, or mark it partly correct.Who decided, and when
Output
A reviewed quality case with disposition and retained evidence.Disposition history

What the workflow supports

What the workflow supports.
OutcomeWorkWhat you receiveProgram fit
AdvanceThe required AuraQC checks and review are complete.Signal reason, Calibration record, Disposition historyConfigured to your model versions, evaluation criteria, and review team.
HoldA required check or approval is missing.What is blocking, and what it needs.Holds remain active until the regression passes replay and reviewer sign-off.
Return for workThe source object or workflow requires correction and another review.The returned items, their owner, and the review route back.Corrected items automatically re-enter verification before acceptance.