Search Query Planning Research QA Specialist

What you should bring

• Prior evaluation, annotation, or human-rater experience on search query planning research qa evaluation or adjacent content for Search Query Planning Research QA Specialist work.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the issue and the rubric clause being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Role signals

Compensation and schedule

Hourly rate confirmed after the interview process.

Expected arrangement: contractor, with program-defined task volume and review pacing. Placement depends on current program demand and reviewer confirmation.

Skills used in matching

• Model output evaluation
• Rubric-based annotation
• Severity tagging
• Inter-rater calibration
• Search Query Planning Research QA evaluation
• Web research
• Source grounding
• Browser automation
• Search
• Query
• Planning

Application boundary

Creating a specialist profile records your experience and preferences. Starting role intake is a separate action that attaches this role to your candidate record.