AI Quality Analyst – Personalization, Spanish

Job not on LinkedIn

🔥 1 minute ago

🇪🇸 Spain – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

Where this job comes from

Posted on Careerflow.ai's careers page ↗Careerflow.ai's careers page, not through a job board

First seen by Remote Rocketship 1 minute ago

Apply Now
Logo of Careerflow.ai

Careerflow.ai

11 - 50 employees

Founded 2022

🤖 Artificial Intelligence

👥 HR Tech

☁️ SaaS

💰 $700k PRE-SEED on 2024-05

Artificial Intelligence • HR Tech • SaaS

Careerflow. ai is an AI-powered job search platform that helps users create and optimize resumes and cover letters, track applications, improve LinkedIn profiles, and prepare for interviews. It also provides career tools to organizations such as university career centers, bootcamps, and outplacement providers.

📋 Description

• Design multi-turn conversational prompts, typically 1–5 turns, requiring the AI to draw on real personal information and experiences • Evaluate whether the model applied personalization correctly • Review responses for grounding issues, including flawed inferences or hallucinations • Assess integration quality and whether personal data is naturally woven into responses • Stack-rank two model responses side-by-side based on helpfulness, ease of use, and overall quality • Write clear, well-structured rationales referencing specific conversation turns • Extract and verify Debug Info to confirm chat summaries and data sources were properly used • Clear evaluation conversations after each session to maintain clean data • Complete the screener, three assessments, and language vetting as part of the hiring process

🎯 Requirements

• Strong English reading and writing skills; the project is conducted entirely in English • Demonstrated ability to evaluate nuanced or ambiguous AI responses and explain reasoning clearly • Comfortable working independently in a remote setup with minimal hand-holding • Reliable desktop or laptop with a stable internet connection • Full-time availability in the local time zone • At least 4 hours of daily overlap with PST • Preferred: experience in data annotation, AI quality evaluation, content moderation, or similar • Preferred: BS/BA degree or equivalent experience in a relevant field such as Policy, Law, Ethics, Linguistics, Journalism, or Computer Science • Preferred: familiarity with personalization concepts and spotting bad inferences or forced connections • Preferred: experience designing prompts or testing AI systems • Preferred: sharp attention to detail when comparing side-by-side responses • Preferred: ability to write specific and actionable feedback

🏖️ Benefits

• Contractor engagement • Choice of 30 hours/week or 40 hours/week • Remote work arrangement • 24-hour global operation with schedule consistency • At least 4 hours of daily overlap with PST

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 2 days ago

DocPlanner

1001 - 5000

🏥 Healthcare

💼 Consulting

📦 Logistics

AI Native Marketer driving acquisition for Noa Notes, Docplanner’s AI medical scribe. Building creative, paid, lifecycle, partnership, and AI-powered growth systems.

🕒 3 days ago

TSMG Holding

51 - 200

💼 Consulting

📦 Logistics

🤖 Artificial Intelligence

Quality Control Specialist reviewing Catalan display transcriptions for TSMG’s AI speech-recognition projects. Correcting punctuation, formatting, capitalization, and text-normalization errors.

🗣️🏴 Catalan Required

🕒 4 days ago

Global Human Capital Group

201 - 500

👥 HR Tech

🎯 Recruiter

💼 Consulting

Forward Deployed Engineer deploying production LLM agents and workflows for a Spain-based AI technology company. Integrating customer systems and shaping the product roadmap.

🕒 5 days ago

Human to Human Hub

11 - 50

📣 Marketing

💼 Consulting

🎯 Recruiter

Asistente virtual con IA gestionando operaciones administrativas y atención al cliente para una empresa española de servicios y negocios digitales. Supervisión de agentes, agendas, documentación y seguimientos.

🗣️🇪🇸 Spanish Required

🕒 5 days ago

GE Vernova

10,000+ employees

💼 Consulting

📦 Logistics

🏭 Manufacturing

GE Vernova energy-transition marketer leading global B2B demand campaigns for Software and Controls Solutions. Driving AI-enabled workflows, optimization, and campaign production efficiency.

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok