Note: The job is a remote job and is open to candidates in USA. Productive Playhouse is a global data company specializing in language and data services. They are seeking detail-oriented Australian English speakers to participate in an AI LLM evaluation project, which involves interacting with AI chatbots and rating the interactions.
Responsibilities
- Speak to AI (using voice mode on the mobile app), using the predefined starting prompt, pursuing the pre-defined conversation goal
- Rate the interaction on your laptop
- Follow the provided instructions to achieve the task goals
- Voice mode interactions and evaluations must be performed with accuracy, completeness, and attention to quality
Skills
- Proficient (C2 CEFR) in English used in Australia (en_au)
- Strong comprehension of English (read and write)
- All participants must have, or be willing to create, an Upwork account
- A Gmail account is required for project communication and access
- You must use your own smartphone and be able to install (free) chatbot apps
- You must use your own laptop
- Candidates should be comfortable and prepared to meet varying conditions (such as quiet or noisy settings, indoors or outdoors)
Company Overview
Productive Playhouse provides international language services including transcription, linguistics, translation, and field data gathering. It was founded in 2009, and is headquartered in Los Angeles, California, USA, with a workforce of 201-500 employees. Its website is https://productiveplayhouse.com/.