Author criteria
Definitions, examples, and validation live in one versioned workspace.
AuraOne Open / Evaluation authoring
Build rubrics reviewers can inspect, test, and diff.
Write criterion-level rubrics. Preview the scoring, calibrate against gold examples, and see what your wording change did to the scores.
For evaluation, model, and Human Data teams that need scoring behavior to stay reviewable before release.
- License
- MIT License
- Data handling
- Rubric projects remain local unless the operator explicitly exports, shares, or connects a hosted service. A read-only example build of the editor runs at rubric-studio.auraone.ai, allowing you to explore the interface in the browser before running locally.
What you can do
Follow the work from input to a usable result.
Get started
Open the source and follow the current README.
Clone the repository, inspect the license and lockfile, then use the current README for supported runtime and build commands.
git clone https://github.com/auraoneai/rubric-studio-open.gitPreview and calibrate
Test local or configured judges against samples and compare agreement with reviewed gold labels.
Diff and export
See how a wording change moves the scores. Then export the rubric spec and judge card.
Rubric Studio Open workflow
See how the product moves from setup through a useful output.
01
Define the criterion
Name the behavior and the scoring scale. Give examples and say what does not count.
Versioned criterion file
02
Preview scoring
Run example responses through the selected scoring path.
Criterion-level scoring trace
03
Calibrate
Compare judge results and human-reviewed gold labels to expose disagreement.
Calibration and drift record
04
Review the diff
Inspect wording changes beside score and classification impact.
Version and score-impact diff
05
Prepare the handoff
Release only the version whose criteria, validation, and ownership are visible.
Rubric manifest and judge card
Release specifications
What is included in this release
Review the current source, release, runtime, and support information.
- Criterion
- Definition, scale, and required evidenceVersioned rubric file
- Validation
- Schema checks, sample coverage, and unsupported conditionsProject validation record
- Calibration
- Gold labels, where the judge disagreed, and the reviewerCalibration run
- Release
- Version, score-impact diff, and judge cardPortable release bundle
Availability
Current release and install details.
Review the current version, source, packages, downloads, supported platforms, and install options.
Rubric Studio Open availability
Rubric Studio Open, its browser editor, and checksum-recorded macOS Apple Silicon release remain on product version 0.2.0. The release notes report Apple signing and notarization; this audit independently verified the GitHub digest, not the Apple trust chain. The npm companion is published separately as 0.2.1.
Rubric Studio Open DMG
macOS Apple Silicon / 0.2.0
GitHub serves this exact SHA-256 digest. The v0.2.0 release notes report Developer ID signing, notarization, and stapling. They also report Gatekeeper acceptance and offline install testing. Those Apple trust checks were not independently rerun during the August 3 website audit.
SHA-256 7dcb7de67835947b421089eab5fc244bcd8f75d503ebc7e763921c229c68f23dContinue exploring
Explore related AuraOne Open products.
Each one lists its source, current version, and install path.