Import and validate
Rubric and response files are schema-checked before scoring, with line-level errors.
AuraOne Open / Browser evaluation
Load a rubric and a set of responses, run deterministic scoring, and inspect the evidence behind every score. Nothing leaves the browser unless you export it.
pip install auraone-evalkitThe example inputs live in the repository. Get them first:
git clone --depth 1 https://github.com/auraoneai/open.git && cd openThen run the example from the repository root:
evalkit score --rubric packages/evalkit/examples/tutorial/rubric.jsonl --responses packages/evalkit/examples/tutorial/model_outputs.jsonl --labels packages/evalkit/examples/tutorial/labels.jsonl --format csvoutput_id,score,passed,applicable_weight,weighted_points,missing_criteria
out-001,0.8375,True,1.0,0.8375,
out-002,0.3,False,1.0,0.3,
out-003,0.8,True,1.0,0.8,What you can do
Rubric and response files are schema-checked before scoring, with line-level errors.
Each criterion shows the points it awarded and why, so a score can be reviewed.
Run the same rubric with the EvalKit CLI or the EvalKit GitHub Action.
See how the product moves from setup through a useful output.
01
Install auraone-evalkit 0.2.0 from source.
Package version
02
Run the quick start on the synthetic fixture and compare it with the output above.
Captured output
03
Point the same command at your own files, locally or in CI.
Local report
Release specifications
Review the current source, release, runtime, and support information.
Availability
Review the current version, source, packages, downloads, supported platforms, and install options.
Version 0.2.0 is available from source tag v0.2.0.
When the work grows
Continue exploring
Each one lists its source, current version, and install path.