
Model Evaluator
Applications open
Rate and compare AI answers and explain why, as paid work from home. It suits careful readers who can say why an answer is wrong, not only that it is.
Remote, Mexico · Freelance
What the work is for
Your ratings and written reasons help train AI models and test their answers.
The work
- Rate and compare AI answers against the project's criteria.
- Write a short, concrete reason for each rating. It matters as much as the rating itself.
- Check the facts in an answer. Rewrite weak answers where the task asks for it.
- Flag unsafe, false or policy-breaking output explicitly.
What to expect
- Each project has its own rating criteria and instructions for judging answers.
- You work in YPAI's own review console, where each project's rating criteria are set up.
You need
- Strong reading comprehension in the language you evaluate.
- The ability to explain why, not only what.
- 18 years or older.
Good to know
- You will read unsafe or offensive output at times. Judging it is part of the work.
- Work depends on the projects running in the language you evaluate. There can be gaps between projects.
Our team reviews applications for this role and contacts selected applicants by email.
Apply
Takes a couple of minutes. No CV needed.
- Payment
- Via PayPal, Wise, or bank transfer
- When you are paid
- Paid every two weeks after approved work.
- Fees to you
- Never, at any stage. If someone asks, it is not us
- Who hires you
- YPAI, a registered Norwegian company that collects and annotates data for AI
Application received
Thank you for applying for Model Evaluator. Our team will review your application and contact you by email if you are selected.
- We have emailed you a receipt.
- Your YPAI Freelance profile is set up too. Use the link in the email to complete, edit or delete it.
- Your YPAI Freelance profile is set up too. Sign in with this email address to complete, edit or delete it.
- This application is saved on your YPAI Freelance profile.
Your application, and any CV you uploaded, are deleted no later than 2 years after you applied.