Outreach is seeking a Staff Test Engineer - AI to own quality for their GenAI platform and agent ecosystem. The ideal candidate will have experience testing complex, probabilistic systems at scale and a genuine curiosity about how AI and LLM-based systems behave, fail, and improve.
Requirements
- 7–12 years of experience in software development and/or test automation
- B.S. in Computer Science or a related technical field
- Strong programming skills in Python
- Proven experience testing large-scale backend or platform systems
- Deep understanding of test design principles, CI/CD integration, and scalable test automation
- Experience with test frameworks such as PyTest or equivalent
- Solid understanding of evaluation methodologies for non-deterministic systems
- Hands-on experience with Databricks for building and validating ML pipelines and data workflows
- Experience with MLflow for experiment tracking, model versioning, and pipeline observability
- Strong communication and collaboration skills across engineering, data science, and product functions
Benefits
- Generous Paid Time Off
- 401k Matching
- Retirement Plan
- Tuition Reimbursement
Originally posted on