AI Agent Evaluator

Job not on LinkedIn

🔥 16 hours ago

🇦🇷 Argentina – Remote

⏱ Part Time

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

👻 Ghost score 11%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Anyone AI

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2022

📚 Education

🤖 Artificial Intelligence

🎯 Recruiter

💰 $1.5M Pre Seed Round - Anyone AI on 2022-06

Education • Artificial Intelligence • Recruitment

Anyone AI is a Latin America–focused career accelerator and training academy that develops software engineers into AI and machine learning professionals through intensive, remote, mentor-led programs. It combines technical coursework (e. g. , Machine Learning Developer track), professional preparation (resume/LinkedIn optimization, interview coaching, English practice), and a placement-oriented model (income-share payments and access to employer partnerships) to help graduates secure higher-paying AI roles globally. Anyone AI also operates a talent marketplace connecting its community to companies seeking AI talent.

📋 Description

• Evaluate how well AI assistants understand users, use personal context, and deliver helpful conversations • Write prompts about questions, interests, or needs relevant to you • Have natural, multi-turn conversations with two AI assistants • Include questions drawing on information or activity from connected services where relevant • Compare how effectively each assistant uses available information and connects relevant context • Assess whether responses feel helpful, natural, trustworthy, and safe • Evaluate how each assistant responds to feedback and corrections • Provide clear explanations supporting evaluations • Complete verification of currently used digital services and recent activity

🎯 Requirements

• Fluency in one of the supported languages/locales: Spanish — Latin America; Arabic; Portuguese — Brazil; Japanese — Japan; Turkish — Turkey; Indonesian — Indonesia; Hindi — India; Korean — Korea; French — France; German — Germany • Strong reading comprehension and ability to explain feedback clearly • Attention to detail and sound judgment when comparing conversation experiences • Willingness to interact with AI assistants using relevant personal context and connected services • Recent activity across a qualifying combination of digital services • Completion of project eligibility verification and corresponding expert requirements • Experience using AI assistants for everyday questions, planning, or research is nice to have • Previous experience in AI evaluation, user research, or quality assurance is nice to have • Ability to identify subtle differences in relevance, personalization, and conversation quality is nice to have

🏖️ Benefits

• Independent contractor / Part-time arrangement • Project duration of up to 3 months • Remote work • Opportunity to contribute to training and evaluation of frontier AI models • Potential consideration for other AI evaluation opportunities if not qualified for this project