Review annotated and transcribed batches against acceptance criteria, adjudicate disagreements and help calibrate annotator agreement. Remote freelance, paid per hour.
The work
- Score batches against the project rubric and document decisions.
- Adjudicate conflicting labels and give concrete feedback.
- Flag guideline gaps so instructions improve.
You need
- Prior annotation, transcription or review experience.
- Structured, consistent judgment and clear written feedback.
- 18 years or older.
Every application is read by a person on our team, and selected candidates get an answer by email. Your application, and any CV you upload, are deleted no later than 2 years after you apply.
Apply
Takes a couple of minutes. No CV needed.
- Payment
- Via PayPal, Wise, or bank transfer
- Minimum payout
- None. You are paid what you have earned
- Fees to you
- Never, at any stage. If someone asks, it is not us
- Who hires you
- YPAI, a registered Norwegian company
Application received
Thanks. Your application for QA Reviewer / Adjudicator is registered and will be read by a person on our team. We have emailed you a receipt with what happens next. Your application, and any CV you uploaded, are deleted no later than 2 years after you applied.
Your capability profile is registered too, so future matching projects can reach you. Check your email for a sign-in link to complete it, or to edit or delete it.