Labeler / Annotator – AI Response Evaluation, French

Job not on LinkedIn

🕒 July 17

🇧🇷 Brazil – Remote

💵 R$75 - R$85 / hour

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

👻 Ghost score 17%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

BPCS, Comprehensive marketing solutions, ltd.

WebsiteLinkedInAll Job Openings

1 - 10 employees

💼 Consulting

📣 Marketing

Consulting • Marketing

BPCS, Comprehensive marketing solutions, ltd. is a marketing agency founded in 2015 by four friends and experienced advertising professionals. The company offers integrated marketing, business consulting, advertising, and marketing strategies. Positioned as a 'big little agency,' BPCS combines the resources of larger firms with the personal touch and commitment of smaller agencies, providing responsive and dedicated services to meet complex marketing challenges.

📋 Description

• Evaluate AI responses across scenarios such as general-purpose Q&A, web search results, file-based and image-based responses, image and file generation tasks, single-turn and multi-turn conversations • Perform side-by-side (SBS) comparisons of AI-generated responses • Evaluate outputs based on accuracy, relevance, clarity, and instruction-following • Identify nuances in tone, meaning, and cultural context across French • Apply detailed, scenario-specific annotation guidelines • Maintain consistency and high-quality evaluations

🎯 Requirements

• Native or professional fluency in French • Strong English reading comprehension (required for guidelines) • Prior experience with side-by-side (SBS) labeling or annotation • Excellent analytical thinking and attention to detail • Ability to quickly understand and apply structured evaluation frameworks

🏖️ Benefits

• Statutory benefits (e.g., paid vacation, aguinaldo, and vacation premium) • Social security and healthcare contributions (IMSS) • Additional benefits aligned with local market practices