Statistics and Probability AI Evaluator is a remote review track for evaluating AI outputs across statistics reasoning, calculations, and research workflows.
ContractorRemote — US-eligibleHourly rate confirmed after the interview process.
Statistics and Probability AI Evaluator is a remote review track for evaluating AI outputs across statistics reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.
Statistics models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.
Bring scientific and technical domain expertise into AI reasoning, research, and dataset review.
Responsibilities
Review AI outputs against current statistics methods, conventions, and prior work for Statistics and Probability AI Evaluator assignments.
Reproduce or sanity-check key derivations, calculations, or experimental claims.
Flag dimensional, methodological, and citation errors with structured severity tags.
Capture the corrected reasoning or worked example so the modeling team can train on it.
Adjudicate disputed answers against textbooks, papers, or community standards.
Maintain reviewer-quality scores in inter-rater calibration cycles.
What you should bring
Graduate-level training or equivalent applied experience in statistics or a closely related field for Statistics and Probability AI Evaluator work.
Hands-on experience publishing, teaching, or advising on the topic at a professional level.
Comfort applying multi-page rubrics consistently across long batches.
Clear written reasoning that cites methods, papers, or worked examples.
Reliable async availability for at least 10 hours per week.
Role signals
Example tasks
Reproduce a statistics derivation from a model output and flag any algebraic or dimensional errors.
Grade a model's literature summary against the cited papers and rate the citation quality.
Adjudicate a disputed answer between two reviewers using textbook methods.
Audit a 25-row batch for rubric consistency and report drift to the program lead.
Useful experience
PhD, postdoc, or industry research experience in the topic area.
Prior work reviewing AI-assisted research tooling and its failure modes.
Multilingual fluency for non-English papers and corpora.
Compensation and schedule
Hourly rate confirmed after the interview process.
Expected arrangement: contractor, with program-defined task volume and review pacing. Placement depends on current program demand and reviewer confirmation.
Skills used in matching
Scientific reasoning
Method validation
Citation review
Quantitative analysis
Statistics
Science and advanced mathematics
AI evaluation
Rubric writing
Expert review
Application process
Submitting this form sends your application directly to the recruiting team for this specialist cohort.
Physics Expert (Condensed Matter / Quantum Information) is a remote review track for evaluating AI outputs across physics reasoning, calculations, and...
ContractorRemote · Independent specialist contractorHourly rate confirmed after the interview process.
Materials Science Domain Expert is a remote review track for evaluating AI outputs across materials science reasoning, calculations, and research workflows.
