Note: The job is a remote job and is open to candidates in USA. Crossing Hurdles is seeking a STEM QA Reviewer specializing in Electrical Engineering. The role involves reviewing graduate-level electrical engineering problems and assessing simulated research environments to ensure scientific realism and quality.
Responsibilities
- Review and render verdicts on graduate-level electrical engineering problems and simulated research environments used as LLM training data
- Evaluate individual STEM QA tasks (Task clarity, ground truth accuracy, grading soundness)
- Assess multi-agent simulated research trajectories for scientific realism and construction quality
- Work is fully asynchronous and self-scheduled self-select problems within your domain expertise via the Surveyor platform
- 48-hour lease per problem, extendable; ~2.5 reviews per week at approximately 2 4 hours each
- 3-week engagement (June 5 June 25) with potential for extension based on performance and project needs
- Paid weekly via Stripe or Wise as an independent contractor
- No access to confidential or proprietary information from any employer or institution
Skills
- MS or PhD in Electrical Engineering or a closely related field required
- Ability to independently verify ground truth solutions to graduate-level EE problems without external support
- Experience evaluating scientific methodology, problem construction, or research quality in a formal academic or professional context
- Strong written communication skills; able to provide structured, actionable feedback with concrete justifications
- Comfortable reading and summarizing multi-step model agent trajectories, including identifying best and worst reasoning paths
- Must be available to work independently within a 48-hour review window per task
- Familiarity with grading rubric design or assessment criteria development is a plus
Company Overview