Back to filtered roles

Human Data / Legal & Policy AI Evaluation

Building Code Plans Examiner

Building Code Plans Examiner is a remote review track for evaluating AI outputs in building code & permitting workflows.

ContractorRemote — US-eligibleHourly rate confirmed after the interview process.

About the role

Building Code Plans Examiner is a remote review track for evaluating AI outputs in building code & permitting workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on it.

Building code & permitting content is judged on precision. AuraOne uses qualified legal and policy reviewers to grade AI outputs the way a senior associate would — with citations, severity tags, and the corrected reasoning alongside the original.

Judge legal, policy, and compliance outputs for precision and risk.

Responsibilities

  • Review AI outputs against current building code & permitting statutes, case law, or policy for Building Code Plans Examiner assignments.
  • Verify citations, jurisdictions, and dates against authoritative sources.
  • Flag risky reasoning, missed exceptions, and policy-adherence gaps with severity tags.
  • Capture the corrected analysis or memo paragraph so the modeling team can train on it.
  • Adjudicate disputed treatments against published authority or firm policy.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

What you should bring

  • Active or recent qualification in building code & permitting or an adjacent practice for Building Code Plans Examiner work.
  • Hands-on experience drafting, reviewing, or advising on real matters.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites authority and names the rule being applied.
  • Reliable async availability for at least 10 hours per week.

Role signals

Example tasks

  • Verify the citations in a model's building code & permitting memo and flag any miscites with severity.
  • Grade a model's statutory reasoning on a complex fact pattern and rate the analysis.
  • Adjudicate a disputed treatment between two reviewers using current authority.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Useful experience

  • Bar admission or legal-equivalent credential in a relevant jurisdiction.
  • Prior experience reviewing AI-assisted legal-research or compliance tooling.
  • Bilingual experience for cross-jurisdiction matters.

Compensation and schedule

Hourly rate confirmed after the interview process.

Expected arrangement: contractor, with program-defined task volume and review pacing. Placement depends on current program demand and reviewer confirmation.

Skills used in matching

  • Legal research
  • Citation review
  • Statutory analysis
  • Policy reasoning
  • Building code & permitting

Application process

Submitting this form sends your application directly to the recruiting team for this specialist cohort.