AI Instructor – Response evaluation (Remote, Central and Eastern Europe in the EU)

What the work is for

YPAI Learn trains people for AI evaluation work in live classes. Your classes take learners from a gut feeling about one AI response to a rating they can back with evidence, and teach them to check each factual claim, each instruction in the prompt and each safety concern before they score.

The work

• Teach the live class “Grade an AI response for accuracy and instruction following”, 90 minutes, from the class kit.
• Teach the live class “Rate a response for safety and write the justification”, 90 minutes, from the class kit.
• Show live how you split a prompt into its explicit instructions, check the response against each one and look up its factual claims in a reliable source.
• Walk learners through a justification that names the exact error, quotes the sentence it sits in and explains how much it lowers the rating.
• Help learners who rate on impressions, miss a false claim stated with confidence, or mark a harmless answer as unsafe.

What to expect

• Each class runs live online in English, with learners joining from around the world; the application also asks what other languages you teach in.
• Each class kit gives you a minute-by-minute plan, slides, speaker notes, a demo of grading a sample response and a backup recording of that demo.
• You teach from your own computer, remotely, with a stable connection, a camera, a microphone and a browser for the grading exercise.
• You take and pass the instructor test for a class before you teach it for the first time.
• Before a teaching assignment starts, you sign an instructor agreement. It covers pay, confidentiality and how class material may be used.
• Each invitation states the class times and the price learners pay, and you see both before you accept.
• Already have a course on response evaluation, or want to make one? You can sell your own recorded course on YPAI Learn too. Bring a course you've built, or build one with our kit. It's the same application.

What you bring

• A sample evaluation you wrote on a public or made-up prompt, with ratings and justifications you can show and explain.
• Experience teaching, coaching new evaluators, reviewing other people's ratings or running training sessions.
• Patience with learners who have never had to defend a rating in writing.

You need

• Hands-on experience evaluating AI responses in real work, on AI training projects or for a team that ships AI features.
• Careful fact-checking against reliable sources, and precise writing when you explain a rating.
• Fluent spoken English, the language the classes are taught in.
• 18 years or older.

Good to know

• Where your employment contract asks for approval of outside work, get it in place before you accept an assignment.
• How often you are invited depends on demand for the classes, and each invitation says how much time it is expected to take.
• It is free to apply, and you do not have to buy or take any YPAI Learn course.