AI Instructor – Rubric writing (Remote, Gulf States and Türkiye)

What the work is for

YPAI Learn trains people for AI training work in live classes. Your classes take learners from a loose idea of what a good answer looks like to a rubric of clear, checkable criteria, and teach them to check whether different graders reach the same score with it.

The work

• Teach the live class “Write a rubric with checkable criteria for one AI task”, 90 minutes, from the class kit.
• Teach the live class “Test a rubric on sample responses and fix the criteria graders disagree on”, 90 minutes, from the class kit.
• Show live how to turn a goal such as “the answer should be helpful” into separate criteria a grader checks one at a time, each with a pass example and a fail example.
• Walk learners through weighting criteria, marking the must-haves, and writing criteria for one specific prompt instead of general ones.
• Help learners whose criteria overlap, depend on taste or bundle two checks into one line, and show them how to split or reword each one.

What to expect

• Learners from around the world join these live online classes, which are held in English. The application asks about any other teaching languages.
• A class kit comes with each class: a plan by the minute, slides, speaker notes, a demo of drafting a rubric and a recording of the demo to fall back on.
• You teach remotely from your own computer with a reliable connection, a camera and a microphone, and share a document on screen as the rubric takes shape.
• Passing the instructor test for a class comes before your first time teaching it.
• Before a teaching assignment starts, you sign an instructor agreement. It covers pay, confidentiality and how class material may be used.
• Each invitation states the class times and the price learners pay, and you see both before you accept.
• Already have a course on rubric writing, or want to make one? You can sell your own recorded course on YPAI Learn too. Bring a course you've built, or build one with our kit. It's the same application.

What you bring

• A rubric or grading guideline you wrote for real work, or one rebuilt on a made-up task, that you can show and explain.
• Experience teaching, writing training material, running workshops or reviewing guidelines written by others.
• Patience with learners who write criteria that sound right but cannot be checked.

You need

• Hands-on experience writing rubrics, grading criteria or guidelines that others used to evaluate AI output.
• Precise written English and an editor's eye for wording that two readers could take in different ways.
• Fluent spoken English, the language the classes are taught in.
• 18 years or older.

Good to know

• If you need your employer's approval for outside work under your contract, have it before you accept any assignment.
• Teaching volume depends on how much demand there is for the classes. Each invitation states the time commitment it expects.
• You pay nothing to apply and do not need to buy or complete a YPAI Learn course.