AuraOne / Models / Regression Bank

Regression Bank

Lock the comparison context. Inspect what changed. Bank the failures you choose to keep.

Evaluation teams comparing candidates against retained failure cases.

At a glance

Regression Bank

Models
01 · Scope
Locked comparison
02 · Operate
Failure deltas
03 · Review
The person who requests the replay.: Select the candidate, hold it, or bank a new case.
04 · Handoff
Retained cases

Input, work, and output

Input

What you provide

  • Baseline and candidate versions with the cases you kept.

Work

What happens

  • Replay. Compare the deltas. Retain the new failures.
  • The same banked cases, replayed against each version.

Output

What you receive

  • A regression verdict with its failed cases and the deploy-gate outcome.

Decision flow

The steps from intake to handoff, in order.

  1. 01

    Scope

    Baseline and candidate versions with the cases you kept.

    Locked comparison

  2. 02

    Operate

    Replay. Compare the deltas. Retain the new failures.

    Failure deltas

  3. 03

    Review

    The same banked cases, replayed against each version.

    The person who requests the replay.: Select the candidate, hold it, or bank a new case.

  4. 04

    Handoff

    A regression verdict with its failed cases and the deploy-gate outcome.

    Retained cases

What you receive

Regression Bank deliverables

Input
Baseline and candidate versions with the cases you kept.Locked comparison
Criteria
The same banked cases, replayed against each version.Failure deltas
Reviewer
The person who requests the replay.Program ownership
Decision
Select the candidate, hold it, or bank a new case.Review record
Output
A regression verdict with its failed cases and the deploy-gate outcome.Retained cases

What the workflow supports

What the workflow supports.
OutcomeWorkWhat you receiveProgram fit
Scoped workflowReplay. Compare the deltas. Retain the new failures.Locked comparisonConfigured to your workflow and goals.
Review decisionSelect the candidate, hold it, or bank a new case.Failure deltasConfigured to your workflow and goals.
Retained handoffA regression verdict with its failed cases and the deploy-gate outcome.Retained casesConfigured to your workflow and goals.

Next step

Apply this operating path to your program.

Bring your source material and its owners. Bring the acceptance criteria and any operating constraints. We will turn them into a scoped plan.

Live from the bank

Aggregate numbers publish here once enough organizations contribute. None are published yet.

The Regression Bank

Replay failures. Block repeats.

Regression Bank keeps accepted failures as replayable cases. A configured release gate holds a candidate that fails one.

Automated replay gates block regression candidates before promotion to production.

Live metrics pending
Illustrative
Regressions blocked
Pending publish floor
Escape rate
Measured per tenant
Replay mode
Banked cases
Illustrative animationNot live failure data

Regression Bank

Banked cases

Illustrative
  • Prompt-injection probe
    PASSED
  • PII leakage probe
    PASSED
  • Hallucination probe
    FAILED
  • Tone drift probe
    PASSED

Select any banked failure case to inspect its prompt, expected behavior, and release gate rule.

Regression Bank

Replay diff

Illustrative
Baseline
Prompt leakfail
Tool timeoutfail
Policy gapfail
Owner missingfail
Candidate
Maskedpass
Retry passedpass
Mappedpass
Assignedpass
Side-by-side comparison of baseline failures against candidate fixes.