API Integration Workflow Reviewer

What you should bring

• Prior evaluation, annotation, or human-rater experience on api integration workflow evaluation or adjacent content for API Integration Workflow Reviewer work.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the issue and the rubric clause being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Role signals

Compensation and schedule

Hourly rate confirmed after the interview process.

Expected arrangement: contractor, with program-defined task volume and review pacing. Placement depends on current program demand and reviewer confirmation.

Skills used in matching

• Model output evaluation
• Rubric-based annotation
• Severity tagging
• Inter-rater calibration
• API Integration Workflow evaluation
• Code review
• Software testing
• Agent evaluation
• Integration

Application boundary

Creating a specialist profile records your experience and preferences. Starting role intake is a separate action that attaches this role to your candidate record.