UI Visual QA Dataset QA Specialist

What you should bring

• Prior evaluation, annotation, or human-rater experience on ui visual qa dataset qa evaluation or adjacent content for UI Visual QA Dataset QA Specialist work.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the issue and the rubric clause being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Role signals

Compensation and schedule

Hourly rate confirmed after the interview process.

Expected arrangement: contractor, with program-defined task volume and review pacing. Placement depends on current program demand and reviewer confirmation.

Skills used in matching

• Model output evaluation
• Rubric-based annotation
• Severity tagging
• Inter-rater calibration
• UI Visual QA Dataset QA evaluation
• Multimodal evaluation
• Cross-modal reasoning
• Grounding review
• Visual

Application boundary

Creating a specialist profile records your experience and preferences. Starting role intake is a separate action that attaches this role to your candidate record.