AI Response Labeler – Castilian Spanish Specialty

Job not on LinkedIn

🔥 13 hours ago

🇺🇸 United States – Remote

💵 $38 - $40 / hour

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

BPCS, Comprehensive marketing solutions, ltd.

WebsiteLinkedInAll Job Openings

1 - 10 employees

💼 Consulting

📣 Marketing

Consulting • Marketing

BPCS, Comprehensive marketing solutions, ltd. is a marketing agency founded in 2015 by four friends and experienced advertising professionals. The company offers integrated marketing, business consulting, advertising, and marketing strategies. Positioned as a 'big little agency,' BPCS combines the resources of larger firms with the personal touch and commitment of smaller agencies, providing responsive and dedicated services to meet complex marketing challenges.

📋 Description

• Perform side-by-side comparisons of AI-generated responses and determine which response is stronger • Evaluate responses for factual accuracy, relevance, completeness, clarity, reasoning, instruction-following, tone, and overall quality • Assess content written in English, Castilian Spanish, or a combination of both • Evaluate general-purpose questions and answers, web-search results, file-based tasks, image-based responses, content-generation requests, and single-turn and multi-turn conversations • Apply Castilian Spanish expertise to language, terminology, tone, regional conventions, idioms, and cultural context specific to Spain • Evaluate complete response quality rather than only grammar, translation, or fluency • Identify unsupported claims, incomplete reasoning, missed instructions, unnatural phrasing, cultural inaccuracies, and differences in usefulness • Apply scenario-specific annotation guidelines accurately and consistently • Make independent evaluation decisions for ambiguous cases • Document decisions and provide concise, evidence-based rationale • Complete evaluations within established time and productivity expectations • Maintain consistent judgment across a high volume of varied assignments • Participate in training, guided practice, calibration sessions, qualification reviews, and quality-review activities • Incorporate feedback and adjust evaluation decisions to team and client quality standards • Complete a minimum of 25 tasks per day, with most tasks taking approximately 15 minutes • Complete the approximately 30-day onboarding and qualification program before production work

🎯 Requirements

• Native-level or professional fluency in Castilian Spanish • Deep familiarity with linguistic conventions, regional vocabulary, idioms, tone, and cultural context of Spanish as used in Spain • Strong English fluency and reading comprehension, including understanding complex prompts, AI-generated responses, and detailed annotation guidelines written in English • Strong general analytical and critical-thinking skills beyond language evaluation • Ability to evaluate content across varied topics, formats, and task types • Ability to assess factuality, relevance, reasoning, clarity, instruction-following, cultural appropriateness, and overall usefulness • Ability to recognize subtle differences in meaning, quality, tone, and user intent • Sound judgment applying structured evaluation criteria to ambiguous or unfamiliar scenarios • Strong written communication skills and ability to explain evaluation decisions clearly and concisely • Excellent attention to detail and ability to maintain accuracy within established time expectations • Ability to learn and consistently apply detailed evaluation frameworks • Ability to work independently while remaining aligned with shared quality standards • Comfort performing repetitive, detail-oriented work for extended periods while maintaining focus, accuracy, and consistent judgment • Ability to receive feedback, recalibrate decisions, and adapt as evaluation guidelines evolve • Experience performing side-by-side labeling, annotation, comparative content evaluation, or quality assessment (preferred) • Experience evaluating AI-generated responses or contributing to model-quality assessment (preferred) • Experience with data labeling or annotation (preferred) • Experience evaluating search relevance, content quality, factual accuracy, or user-facing digital experiences (preferred) • Experience working with detailed guidelines, rubrics, or structured decision-making frameworks (preferred) • Candidates must be authorized to work in the United States and reside within a U.S. time zone

🏖️ Benefits

• Medical, dental, and vision coverage • Flexible Spending Account (FSA) • 401(k) retirement plan • Competitive paid time off • Parental leave • Professional growth and development opportunities