Note: The job is a remote job and is open to candidates in USA. Prolific is a leader in the AI space, focused on building a vast pool of quality human data. They are seeking Computer Science Specialists to join their Expert Network to assist in training and evaluating AI models by reviewing and ranking AI-generated responses, ensuring scientific integrity, and providing feedback for model improvement.
Responsibilities
- AI Evaluation & Ranking: comparing multiple AI-generated responses to technical prompts and ranking them based on accuracy, logic, and safety
- Scientific Review: reviewing CS research papers alongside AI-generated summaries and graphical abstracts to ensure scientific integrity
- Fact-Checking: identifying inaccuracies where the AI has misinterpreted technical data, formulas, or research findings
- RLHF (Reinforcement Learning from Human Feedback): providing the human 'ground truth' to help models align with professional standards in software engineering and data science
- Code & Logic Verification: auditing AI-generated code snippets or architectural diagrams for structural and functional correctness
Skills
- At minimum, a BSc (Bachelor of Science) in Computer Science or a closely related technical field
- Ability to interpret research papers, understand complex algorithms, and review code logic
- High level of cognitive competency with a sharp eye for technical hallucinations or logical flaws
- A valid LinkedIn profile to verify your degree and background during the screening process
- A PayPal account to receive payment from our clients
Benefits
- Competitive pay rates
- Flexible hours
- The ability to work from home
Company Overview
Building the most advanced global infrastructure for People Science. It was founded in 2014, and is headquartered in London, England, GBR, with a workforce of 51-200 employees. Its website is https://www.prolific.com/.Company H1B Sponsorship
Prolific has a track record of offering H1B sponsorships, with 12 in 2025, 7 in 2024, 16 in 2023, 39 in 2022, 16 in 2021, 8 in 2020. Please note that this does not guarantee sponsorship for this specific role.