Human Data / Enterprise Workflow & Tool Use
Responsible AI / Security Specialist — AI Safety Review
Responsible AI / Security Specialist — AI Safety Review is a remote review track for evaluating AI outputs across responsible ai / security specialist operations workflows.
About the role
Responsible AI / Security Specialist — AI Safety Review is a remote review track for evaluating AI outputs across responsible ai / security specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it.
Responsible AI / Security specialist operations AI has to fit into an actual day at work. AuraOne uses experienced operators to grade outputs the way a senior peer would — checking workflow, policy, and the unwritten rules that decide whether a task actually gets done.
Judge tool-use tasks and enterprise agent behavior. Operational judgment is the skill.
Responsibilities
- Review AI outputs against current responsible ai / security specialist operations workflows, playbooks, and firm policy for Responsible AI / Security Specialist — AI Safety Review assignments.
- Grade tone, escalation logic, and stakeholder fit on a structured rubric.
- Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
- Capture the right next step so the modeling team can train on it.
- Adjudicate disputed treatments against published playbooks or firm guidance.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
What you should bring
- Direct working experience in responsible ai / security specialist operations on real teams for Responsible AI / Security Specialist — AI Safety Review work.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the policy or workflow being applied.
- Strong attention to detail and the ability to flag when a prompt itself is the problem.
- Reliable async availability for at least 10 hours per week.
Role signals
Example tasks
- Grade a model's response to a real responsible ai / security specialist operations ticket and rate workflow, tone, and escalation.
- Flag a missed escalation with the right severity tag and corrected next step.
- Adjudicate a disputed playbook call between two reviewers using firm guidance.
- Audit a 25-row batch for rubric consistency and report drift to the program lead.
Useful experience
- Prior experience training, calibrating, or QA-ing operations teams.
- Familiarity with AI-assisted workflow tooling and its failure modes.
- Bilingual experience for cross-region operations.
Compensation and schedule
$90–$140 / hr
Expected arrangement: contractor, with program-defined task volume and review pacing. Placement depends on current program demand and reviewer confirmation.
Skills used in matching
- Operational review
- Policy adherence
- Workflow judgment
- Stakeholder communication
- Responsible AI / Security specialist operations
Application process
Submitting this form sends your application directly to the recruiting team for this specialist cohort.
About AuraOne
AuraOne is a human data company for AI teams and a workflow service for enterprises. It supplies expert judgment, speech, physical-world data and checked workflows.