[Remote] Labeler / Annotator – AI Response Evaluation (French)

Note: The job is a remote job and is open to candidates in USA. Blueprint Technologies is a technology solutions firm headquartered in Bellevue, Washington, seeking a detail-oriented Labeler / Annotator to evaluate AI-generated responses in French. The role involves performing side-by-side evaluations of AI outputs to improve their understanding and communication in the French language.

Responsibilities

• Perform side-by-side (SBS) comparisons of AI-generated responses
• Evaluate outputs based on:
• Accuracy
• Relevance
• Clarity
• Instruction-following
• Identify nuances in tone, meaning, and cultural context across French
• Apply detailed, scenario-specific annotation guidelines
• Maintain consistency and high-quality evaluations

Skills

• Native or professional fluency in French
• Strong English reading comprehension (required for guidelines)
• Prior experience with side-by-side (SBS) labeling or annotation
• Excellent analytical thinking and attention to detail
• Ability to quickly understand and apply structured evaluation frameworks
• Background in linguistics, translation, or localization
• Experience in AI evaluation
• Experience in data annotation
• Experience in search relevance or content quality analysis

Benefits

• Statutory benefits (e.g., paid vacation and aguinaldo / Sueldo Anual Complementario (SAC))
• Social security contributions and healthcare coverage (Obra Social)
• Additional benefits aligned with local market practices
• Training sessions and practice exercises
• Calibration against quality benchmarks
• Qualification review before moving into production work
• This role is hired through an Employer of Record (EOR) partner, ensuring full compliance with local labor laws and payroll requirements

Company Overview

Company H1B Sponsorship