Note: The job is a remote job and is open to candidates in USA. OneDigital is a forward-thinking company that is revolutionizing client services through innovative technology. They are seeking an AI Quality Assurance Analyst to ensure the reliability and accuracy of AI-powered applications, collaborating closely with engineers and product managers to maintain high quality standards.
Responsibilities
- Design and execute test plans for AI-powered applications across both output quality and functional behavior
- Evaluate AI responses for accuracy, consistency, hallucination, and edge case handling
- Test application workflows, UI behavior, and integrations across internal and client-facing tools
- Identify, document, and track defects using standard issue tracking tools (e.g., Jira or equivalent)
- Partner with AI Builders and Product Managers to define acceptance criteria and quality standards for AI features
- Develop and maintain repeatable test cases and QA documentation as AI applications evolve
- Conduct regression testing as applications are updated or new features are released
- Collaborate with the Principal Engineer and product team to surface quality risks early in the build process
- Contribute to defining what “good” looks like for AI output quality at OneDigital, helping shape internal QA standards for LLM-based applications
- Support testing across multiple business lines including Employee Benefits, Retirement, Wealth, and P&C
Skills
- Strong ability to evaluate AI-generated outputs for quality, accuracy, and appropriateness
- Experience writing and executing test cases and documenting defects clearly
- Comfort working in no-code and low-code environments
- Strong written communication skills, with the ability to describe issues precisely and concisely
- Curiosity and adaptability in a fast-moving, emerging technology space
- Ability to work independently and manage multiple testing workstreams at once
- Bachelor's degree or equivalent experience
- Prior experience in a QA role within a software, SaaS, or technology-adjacent environment
- Familiarity with issue tracking tools (e.g., Jira, Linear, or similar)
- Understanding of AI governance, data privacy, and responsible AI considerations
- Experience in a QA, testing, or quality-focused role, with some exposure to AI or LLM based products preferred
- Familiarity with prompt-driven systems and an intuition for how language models can fail or produce unexpected results
- Exposure to AI or LLM-based tools, either professionally or through independent exploration
Benefits
- Variable compensation, commission, and/or annual bonus based on your individual performance and/or the company’s performance
- Health, wellbeing, retirement, and other financial benefits
- Paid time off
- Overtime pay for non-exempt employees
- Robust learning and development programs
- Reimbursement of job-related expenses per the company policy
- Employee perks and discounts
Company Overview
Company H1B Sponsorship