QA Reviewer / Adjudicator
Applications open
QA review and adjudication · Remote, United States · Freelance
Review annotated and transcribed batches against acceptance criteria, adjudicate disagreements and help calibrate annotator agreement. Remote freelance, paid per hour.
The work
- Score batches against the project rubric and document decisions.
- Adjudicate conflicting labels and give concrete feedback.
- Flag guideline gaps so instructions improve.
You need
- Prior annotation, transcription or review experience.
- Structured, consistent judgment and clear written feedback.
- 18 years or older.
Every application is read by a person on our team, and selected candidates get an answer by email. Your application, and any CV you upload, are deleted no later than 2 years after you apply.
Apply
Takes a couple of minutes. No CV needed.
- Payment
- Via PayPal, Wise, or bank transfer
- Minimum payout
- None. You are paid what you have earned
- Fees to you
- Never, at any stage. If someone asks, it is not us
- Who hires you
- YPAI, a registered Norwegian company
Application received
Thanks. We have received your application for QA Reviewer / Adjudicator, and it will be assessed for this role. We have emailed you a receipt. Your application, and any CV you uploaded, are deleted no later than 2 years after you applied.
Your YPAI Freelance profile is set up too. Check your email for a sign-in link to complete it, or to edit or delete it.