Note: The job is a remote job and is open to candidates in USA. Blueprint Technologies is a technology solutions firm headquartered in Bellevue, Washington, specializing in solving complex problems through innovative technology. They are seeking a detail-oriented Labeler / Annotator to evaluate AI-generated responses in Italian, focusing on accuracy, relevance, and clarity across various scenarios.
Responsibilities
- Perform side-by-side (SBS) comparisons of AI-generated responses
- Evaluate outputs based on:
- Accuracy
- Relevance
- Clarity
- Instruction-following
- Identify nuances in tone, meaning, and cultural context across Italian
- Apply detailed, scenario-specific annotation guidelines
- Maintain consistency and high-quality evaluations
Skills
- Native or professional fluency in Italian
- Strong English reading comprehension (required for guidelines)
- Prior experience with side-by-side (SBS) labeling or annotation
- Excellent analytical thinking and attention to detail
- Ability to quickly understand and apply structured evaluation frameworks
- Background in linguistics, translation, or localization
- Experience in AI evaluation
- Experience in data annotation
- Experience in search relevance or content quality analysis
Benefits
- Statutory benefits (e.g., paid leave, 13th salary where applicable)
- Social security and healthcare contributions
- Additional benefits aligned with local market practices
Company Overview
Blueprint is redefining the data solutions ecosystem. It was founded in 2013, and is headquartered in Bellevue, Washington, USA, with a workforce of 501-1000 employees. Its website is https://bpcs.com/.Company H1B Sponsorship
Blueprint has a track record of offering H1B sponsorships, with 3 in 2025, 1 in 2024, 1 in 2023, 3 in 2021, 1 in 2020. Please note that this does not guarantee sponsorship for this specific role.