Model Evaluator
Applications open
Rate and compare AI answers and explain why, as paid work from home. It suits careful readers who can say why an answer is wrong, not only that it is.
Remote, New Zealand · Freelance
Typical project pay
NZD 35-100 per hour
Each project invitation states the work, your pay, what the pay covers and what the work must meet. You see it before you accept.
- Where
- Remote, New Zealand
- Contract
- Freelance
- Status
- Applications open
Takes a couple of minutes. No CV needed.
What the work is for
Your ratings and written reasons help train AI models and test their answers.
The work
- Rate and compare AI answers against the project's criteria.
- Write a short, concrete reason for each rating. It matters as much as the rating itself.
- Check the facts in an answer. Rewrite weak answers where the task asks for it.
- Flag unsafe, false or policy-breaking output explicitly.
What to expect
- Each project has its own rating criteria and instructions for judging answers.
- You work in YPAI's own review console, where each project's rating criteria are set up.
You need
- Strong reading comprehension in the language you evaluate.
- The ability to explain why, not only what.
- 18 years or older.
Good to know
- You will read unsafe or offensive output at times. Judging it is part of the work.
- Work depends on the projects running in the language you evaluate. There can be gaps between projects.
Our team reviews applications for this role and contacts selected applicants by email. Applying does not guarantee project work.
- Payment
- Via PayPal, Wise, or bank transfer
- When you are paid
- Paid every two weeks after approved work.
- Fees to you
- Never, at any stage. If someone asks, it is not us
- Who hires you
- YPAI, a registered Norwegian company that collects and annotates data for AI
Apply
Takes a couple of minutes. No CV needed.
Application received
Thank you for applying for Model Evaluator. Our team will review your application and contact you by email if you are selected.
- We have emailed you a receipt.
- We will email your receipt shortly, together with your other applications from today.
- Your YPAI Freelance profile is set up too. Use the link in the email to complete, edit or delete it.
- Your YPAI Freelance profile is set up too. Sign in with this email address to complete, edit or delete it.
- This application is saved on your YPAI Freelance profile.
Your application, and any CV you uploaded, are deleted no later than 2 years after you applied.
YPAIlinkedin.com/company/ypai-ai
