AI Instructor – Response ranking

What the work is for

YPAI Learn teaches the practical side of AI training work in live classes. Your classes take learners from ordering responses by first impression to rankings that follow the guidelines and match reference rankings, and teach them to check where their judgement drifts.

The work

• Teach the live class “Rank a set of AI responses against the project guidelines”, 90 minutes, from the class kit.
• Teach the live class “Calibrate your rankings against reference examples and close the gaps”, 90 minutes, from the class kit.
• Show live how you rank four responses to one prompt: set aside any that break a hard rule in the guidelines, order the rest and note the reason for each place.
• Walk learners through a calibration round: compare their order with a reference ranking, find the guideline line behind each difference and rank a fresh set.
• Help learners who swap near-equal responses back and forth, lose track of a guideline halfway through a set, or slow down with every task.

What to expect

• Classes are held in English, live and online, and learners log in from many countries; tell us in the application which other languages you can teach in.
• Your kit for each class includes a minute-by-minute plan, slides, speaker notes, a ranking demo and a backup recording of that demo.
• Classes are taught remotely from your own computer; you need a stable connection, a camera, a microphone and enough screen space to show several responses side by side.
• Before you teach a class for the first time, you pass its instructor test.
• Before a teaching assignment starts, you sign an instructor agreement. It covers pay, confidentiality and how class material may be used.
• Each invitation states the class times and the price learners pay, and you see both before you accept.
• Already have a course on response ranking, or want to make one? You can sell your own recorded course on YPAI Learn too. Bring a course you've built, or build one with our kit. It's the same application.

What you bring

• Ranking work you can show on public or made-up prompts, with the guideline you followed and your reasons.
• Experience teaching, training new raters, leading review sessions or giving feedback on ranking work.
• Patience with learners who rank quickly but cannot yet say why one response sits above another.

You need

• Hands-on experience ranking AI responses against written guidelines on real AI training projects.
• Experience with calibration or quality review, from either side: having your work reviewed or reviewing others.
• Fluent spoken English, the language the classes are taught in.
• 18 years or older.

Good to know

• Check your employment contract: if outside work needs approval, arrange it before accepting an assignment.
• The number of classes you teach depends on demand. An invitation always states the expected time commitment.
• The application is free, and buying or taking a YPAI Learn course is not required.