Quality lead contract

Careerflow Human Data Labs partners with AI companies to bring real-world professional expertise into their products.

About the role

Lead QA reviewers to ensure annotated data is accurate, consistent, and delivered on time. The role involves managing review queues, identifying errors, providing feedback, and supporting annotators in a fast-paced environment with tight turnaround times.

Key Responsibilities

• Lead QA reviewers and manage audit and review queues.
• Spot-check annotated data and reviewer decisions.
• Provide clear, actionable, and consistent feedback.
• Conduct office hours and clarify guidelines for annotators.
• Track quality scores, error trends, and reviewer performance.
• Train new reviewers on guidelines, tools, and review processes.
• Escalate recurring issues and unclear guidelines to the Senior QA Lead.

Required Qualifications

• 3–5 years of overall experience, including 1+ year leading or mentoring reviewers.
• Strong attention to detail and ability to follow complex guidelines.
• Clear communication and feedback skills.
• Experience in QA, annotation, data labeling, or AI training data is preferred.

Offer Details:

1. This is a project-based role involving a defined number of evaluation tasks.
2. Each task will involve comparing multiple chatbots and providing a final assessment.
3. Work Schedule: Five working days per week, including weekends as required, with two weekdays off.
4. Work Hours - 7am-4pm PST
5. Duration: 16 weeks.