AI Quality Analyst – Personalization, German

Job not on LinkedIn

🔥 5 minutes ago

💵 $14 / hour

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🗣️🇧🇷🇵🇹 Portuguese Required

Where this job comes from

Posted on Careerflow.ai's careers page ↗Careerflow.ai's careers page, not through a job board

First seen by Remote Rocketship 5 minutes ago

Apply Now
Logo of Careerflow.ai

Careerflow.ai

11 - 50 employees

Founded 2022

🤖 Artificial Intelligence

👥 HR Tech

☁️ SaaS

💰 $700k PRE-SEED on 2024-05

Artificial Intelligence • HR Tech • SaaS

Careerflow. ai is an AI-powered job search platform that helps users create and optimize resumes and cover letters, track applications, improve LinkedIn profiles, and prepare for interviews. It also provides career tools to organizations such as university career centers, bootcamps, and outplacement providers.

📋 Description

• Evaluate a new Gemini personalization feature using information from Gemini conversations, Gmail, Google Search, and YouTube activity • Design and execute multi-turn conversational prompts, typically 1–5 turns, using personal information and experiences • Evaluate model responses based on the intent of the starting prompt • Analyze responses for Grounding issues, unsupported claims, flawed inferences, and hallucinations • Assess Integration quality and whether personal data is used naturally without robotic overnarrating • Stack-rank two model responses side-by-side to determine which is more helpful, easy to use, and enjoyable • Write clear, defensible rationales referencing issues or positive aspects in specific conversation turns • Extract and verify Debug Info to confirm chat summaries and data sources were properly utilized • Delete evaluation conversations to prevent them from polluting future chat history

🎯 Requirements

• Ability to read and write in Portuguese with a high degree of proficiency • Full-time availability in the local time zone • Exceptional analytical thinking for evaluating nuanced and ambiguous AI responses • Experience designing creative, multi-turn prompts based on personal context • Understanding of personalization concepts, including identifying incorrect personalization, poor inferences, and forced connections • Ability to review Side-by-Side (SxS) model responses and identify subtle differences • Excellent written communication and ability to write clear, concise, structured rationales referencing specific turn numbers • Ability to provide constructive feedback and detailed annotations • Excellent communication and collaboration skills • Ability to work independently in a remote setting • Desktop/laptop with a good internet connection • BS/BA degree or equivalent experience in a relevant field • Experience in data annotation, AI quality evaluation, content moderation, or related work strongly preferred • Willingness to use a primary personal Google account and enable personal data sources • Minimum commitment of 4 hours per day and 30 hours per week, with 4 hours of overlap with PST

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 3 days ago

WBS

201 - 500

💼 Consulting

⚡ Energy

KI-Trainer:in bei WBS TRAINING gestaltet digitale Lernprozesse im Homeoffice. Vermittlung von Prompting, KI-Tools und praxisnaher Mensch-KI-Zusammenarbeit.

🗣️🇩🇪 German Required

🕒 3 days ago

WBS Training

1 - 10

📚 Education

💸 Finance

🤝 B2B

KI-Trainer:in bei WBS TRAINING vermittelt Prompting und Mensch-KI-Zusammenarbeit. Durchführung praxisnaher Online-Lehre aus dem Homeoffice im WBS LearnSpace 3D®.

🗣️🇩🇪 German Required

🕒 4 days ago

Welo Global

1001 - 5000

🤖 Artificial Intelligence

🤝 B2B

☁️ SaaS

Welo Data evaluating AI coding agents across languages through a short paid project. Translating software engineering task briefs while preserving code, commands, and test conditions.

🗣️🇩🇪 German Required

🕒 4 days ago

WBS

201 - 500

💼 Consulting

⚡ Energy

AI and Work 5.0 trainer delivering remote courses for WBS TRAINING. Teaching prompting, human-AI collaboration, productivity, innovation, and risk management.

🗣️🇩🇪 German Required

🕒 4 days ago

WBS Training

1 - 10

📚 Education

💸 Finance

🤝 B2B

KI-Trainer:in bei WBS TRAINING für praxisnahe Mensch-KI-Zusammenarbeit. Vermittlung von Prompting, KI-Tools und Arbeitswelt-5.0-Kompetenzen im Homeoffice.

🗣️🇩🇪 German Required

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok