← All jobs

Model Evaluator

Model evaluation (RLHF) · Remote, Colombia · Freelance

Read what an AI model produced and judge it: which answer is better, where it is wrong, whether it is safe. Your judgement is the training signal, so the reasoning matters as much as the rating.

The work

  • Rate and compare model outputs against the project's rubric.
  • Write short, concrete justifications for your rating.
  • Flag unsafe, false or policy-breaking output explicitly.

You need

  • Strong reading comprehension in the language you evaluate.
  • The ability to explain why, not only what.
  • 18 years or older.

Every application is read by a person on our team, and selected candidates get an answer by email. Your application, and any CV you upload, are deleted no later than 2 years after you apply.

Apply

Takes a couple of minutes. No CV needed.

Payment
Via PayPal, Wise, or bank transfer
Minimum payout
None. You are paid what you have earned
Fees to you
Never, at any stage. If someone asks, it is not us
Who hires you
YPAI, a registered Norwegian company
PDF, max 5 MB. Skip it if you do not have one. Your experience matters more than the document.

You see the confirmation here and get a copy by email.