
11 - 50 employees
Founded 2022
🤖 Artificial Intelligence
👥 HR Tech
☁️ SaaS
💰 $700k PRE-SEED on 2024-05
Artificial Intelligence • HR Tech • SaaS
Careerflow. ai is an AI-powered job search platform that helps users create and optimize resumes and cover letters, track applications, improve LinkedIn profiles, and prepare for interviews. It also provides career tools to organizations such as university career centers, bootcamps, and outplacement providers.
🔥 11 minutes ago
🇵🇱 Poland – Remote
💵 $14 / hour
⏳ Contract/Temporary
🟡 Mid-level
🟠 Senior
🤖 Artificial Intelligence
👻 Ghost score 0%
🗣️🇵🇱 Polish Required
Where this job comes from
Posted on Careerflow.ai's careers page ↗, not through a job board
First seen by Remote Rocketship 11 minutes ago

11 - 50 employees
Founded 2022
🤖 Artificial Intelligence
👥 HR Tech
☁️ SaaS
💰 $700k PRE-SEED on 2024-05
Artificial Intelligence • HR Tech • SaaS
Careerflow. ai is an AI-powered job search platform that helps users create and optimize resumes and cover letters, track applications, improve LinkedIn profiles, and prepare for interviews. It also provides career tools to organizations such as university career centers, bootcamps, and outplacement providers.
• Evaluate a new Gemini personalization feature using information from past Gemini conversations, Gmail, Google Search, and YouTube activity • Design and execute multi-turn conversational prompts, typically 1–5 turns, based on personal information and experiences • Evaluate model responses against the intent of the starting prompt • Analyze responses for Grounding issues, unsupported claims, flawed inferences, and hallucinations • Assess Integration quality and whether personal data is used naturally without robotic overnarrating • Stack-rank two model responses side-by-side for helpfulness, usability, and enjoyment • Write clear, defensible rationales referencing specific conversation turns • Extract and verify Debug Info to confirm chat summaries and data sources were properly utilized • Maintain data hygiene by deleting evaluation conversations
• Ability to read and write in Polish with a high degree of proficiency • Full-time availability in the local time zone • Exceptional analytical thinking for nuanced and ambiguous AI responses • Experience designing creative, multi-turn prompts based on personal context • Understanding of personalization concepts, including incorrect personalization, poor inferences, and forced connections • Ability to review Side-by-Side (SxS) model responses and identify subtle differences in naturalness and overnarrating • Excellent written communication and ability to write clear, concise, structured rationales referencing specific turn numbers • Ability to provide constructive feedback and detailed annotations • Excellent communication and collaboration skills • Ability to work independently in a remote setting • Desktop/laptop with a good internet connection • BS/BA degree or equivalent experience in a relevant field • Experience in data annotation, AI quality evaluation, content moderation, or related work strongly preferred • Willingness to use a primary personal Google account and enable personal data sources • Minimum commitment of 4 hours per day and 30 hours per week, with 4 hours of overlap with PST • Contractor engagement type
Apply NowImprove your chances of getting an interview by checking your resume score before you apply.
🕒 November 7
Freelance Ukrainian language specialist challenging AI models on Ukrainian linguistics. Documenting failures and improving prompt engineering and evaluation metrics for Meridial.
🇵🇱 Poland – Remote
💵 $8 - $65 / hour
💰 $100M Series unknown on 2025-10
⏳ Contract/Temporary
🟡 Mid-level
🟠 Senior
🤖 Artificial Intelligence
🗣️🇺🇦 Ukrainian Required
🕒 November 6
Russian-fluent STEM specialist challenging and evaluating language models for Meridial. Creating training data to improve AI scientific reasoning and technical problem-solving.
🇵🇱 Poland – Remote
💵 $8 - $65 / hour
💰 $100M Series unknown on 2025-10
⏳ Contract/Temporary
🟡 Mid-level
🟠 Senior
🤖 Artificial Intelligence
🗣️🇷🇺 Russian Required
🕒 November 6
Science specialist challenging and evaluating AI models across scientific disciplines. Improving model reasoning through factual verification, error tracing, and evaluation metrics at Meridial.
🇵🇱 Poland – Remote
💵 $8 - $65 / hour
💰 $100M Series unknown on 2025-10
⏳ Contract/Temporary
🟡 Mid-level
🟠 Senior
🤖 Artificial Intelligence
🗣️🇷🇺 Russian Required
🕒 November 6
Polish Data Rater evaluating e-commerce filters, results, and product data. Supporting Welocalize’s multilingual AI and data transformation services remotely from Poland.
🗣️🇵🇱 Polish Required
🕒 November 6
Russian language specialist challenging AI models on grammar, semantics, and dialects. Documenting failures and improving prompts and evaluation metrics for Meridial’s language-training projects.
🇵🇱 Poland – Remote
💵 $6 - $65 / hour
💰 $100M Series unknown on 2025-10
⏳ Contract/Temporary
🟡 Mid-level
🟠 Senior
🤖 Artificial Intelligence
🗣️🇷🇺 Russian Required