Input
Start with the source material.
- Baseline and candidate versions with the cases you kept.
AuraOne / Product walkthroughs
Loading the walkthrough.
Loading the interactive workflow.
AuraOne / Product walkthroughs
Loading the interactive workflow.
AuraOne / Models / Interactive walkthrough
Lock the comparison context. Inspect what changed. Keep every new failure with its owner.
Evaluation teams comparing candidates against retained failure cases. Explore the workflow before we configure it for your team.
At a glance
Workflow overview
Start with the source material, explicit criteria, and a named reviewer.
| Field | Illustrative value | Status |
|---|---|---|
| Input | Baseline and candidate versions with the cases you kept. | Attached |
| Criteria | Same cases, same rubric, same thresholds. | Versioned |
| Reviewer | The evaluation owner and a domain reviewer. | Assigned |
Follow the work from the starting material through review and handoff.
Input
Work
Output
See what happens at each checkpoint and what moves forward.
01
Baseline and candidate versions with the cases you kept.
Locked comparison
02
Replay. Compare the deltas. Retain the new failures.
Failure deltas
03
Select the candidate, hold it, or bank a new case.
Named decision and owner
04
A regression verdict with failed cases and recommendation.
Retained cases
Inside the walkthrough
Your configured program uses your actual source material, owners, criteria, and approvals.
Bring your workflow
The structured brief captures the source work and the decision. It captures the stakes, the reviewers, and the timeline. It never asks for restricted material.
Aggregate numbers publish automatically once enough organizations contribute to the bank. Until then we keep the story, not the scoreboard.
The first time a model fails, the evidence is banked — the prompt, the reply, the context around it, and the owner who signs for it. It never has to be rediscovered.
Incident
Retained failure
Release
Current candidate
Source
Runtime capture
Environment
Production
Domain
Customer workflows
Owner
Evaluation owner
The retained prompt that produced the failure.
The response that missed the requirement.
Bank the failure
Signature, context, and evidence are written to the bank with an owner and an audit record.
Replay it through Prism
The case runs against the candidate under the same rubric and thresholds that caught it.
Gate the release
A regressed candidate is held at the gate with a keyed, signed verdict. Passed cases stay in the bank.
Captured prompt
attachedCase input
The exact prompt and context that produced the failure.
Failing reply
attachedCase output
The recorded response the rubric rejected.
Signed verdict
linkedGate output
The keyed, signed verdict recorded on the terminal write.