WHAT YOU WILL DO:
Listen to ~5-minute recorded conversations between English learners and an AI tutor. For each session, rate the learner (not the tutor) across 10 sub-scales organised under 5 criteria:
- Pronunciation (Sounds, Prosody)
- Grammar (Range, Accuracy)
- Vocabulary (Range, Control)
- Fluency (Speech rate, Smoothness)
- Conversation (Turn-taking, Engagement)
For each sub-scale, you select a CEFR band (A1-C2) and write a short reason explaining your rating. The reason must be specific, observable, and clearly tied to your band choice.
You'll work in our custom web platform: audio playback, synced transcript, inline annotation. A detailed CEFR rubric is provided and walked through during onboarding.
PILOT SCOPE:
- 6 sessions per rater (same set for everyone in the pilot)
- You get paid for all 6 regardless of what happens next
- 10–15 minutes per session
After the pilot we compare ratings across the group. Raters whose work aligns well with group consensus will be invited to continue with more annotation work.
YOU WILL BE A GREAT FIT IF:
- 3+ years of ESL / EFL / TESOL teaching experience
- Strong working knowledge of CEFR descriptors (A1-C2)
- Native or C2-level English
- Bonus: IELTS / Cambridge / TOEFL examiner training
Apply tot his job
Apply To this Job