AI Instructor – Response evaluation (Remote, South Asia)

What the work is for

YPAI Learn trains people for AI evaluation work in live classes. Your classes take learners from a gut feeling about one AI response to a rating they can back with evidence, and teach them to check each factual claim, each instruction in the prompt and each safety concern before they score.

The work

• Teach the live class “Grade an AI response for accuracy and instruction following”, 90 minutes, from the class kit.
• Teach the live class “Rate a response for safety and write the justification”, 90 minutes, from the class kit.
• Show live how you split a prompt into its explicit instructions, check the response against each one and look up its factual claims in a reliable source.
• Walk learners through a justification that names the exact error, quotes the sentence it sits in and explains how much it lowers the rating.
• Help learners who rate on impressions, miss a false claim stated with confidence, or mark a harmless answer as unsafe.

What to expect

• Each class runs live online in English, with learners joining from around the world; the application also asks what other languages you teach in.
• Each class kit gives you a minute-by-minute plan, slides, speaker notes, a demo of grading a sample response and a backup recording of that demo.
• You teach from your own computer, remotely, with a stable connection, a camera, a microphone and a browser for the grading exercise.
• You take and pass the instructor test for a class before you teach it for the first time.
• Before a teaching assignment starts, you sign an instructor agreement. It covers pay, confidentiality and how class material may be used.
• Each invitation states the class times and the price learners pay, and you see both before you accept.
• Already have a course on response evaluation, or want to make one? You can sell your own recorded course on YPAI Learn too. Bring a course you've built, or build one with our kit. It's the same application.

What you bring

• A sample evaluation you wrote on a public or made-up prompt, with ratings and justifications you can show and explain.
• Experience teaching, coaching new evaluators, reviewing other people's ratings or running training sessions.
• Patience with learners who have never had to defend a rating in writing.

You need

• Hands-on experience evaluating AI responses in real work, on AI training projects or for a team that ships AI features.
• Careful fact-checking against reliable sources, and precise writing when you explain a rating.
• Fluent spoken English, the language the classes are taught in.
• 18 years or older.

Good to know

• Where your employment contract asks for approval of outside work, get it in place before you accept an assignment.
• How often you are invited depends on demand for the classes, and each invitation says how much time it is expected to take.
• It is free to apply, and you do not have to buy or take any YPAI Learn course.