Research Scientist – Remote, US, LATAM

Job not on LinkedIn

🔥 0 minutes ago

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Anyone AI

Anyone AI

11 - 50 employees

Founded 2022

📚 Education

🤖 Artificial Intelligence

🎯 Recruiter

💰 $1.5M Pre Seed Round - Anyone AI on 2022-06

Education • Artificial Intelligence • Recruitment

Anyone AI is a Latin America–focused career accelerator and training academy that develops software engineers into AI and machine learning professionals through intensive, remote, mentor-led programs. It combines technical coursework (e. g. , Machine Learning Developer track), professional preparation (resume/LinkedIn optimization, interview coaching, English practice), and a placement-oriented model (income-share payments and access to employer partnerships) to help graduates secure higher-paying AI roles globally. Anyone AI also operates a talent marketplace connecting its community to companies seeking AI talent.

📋 Description

• Evaluation research. Turn public benchmarks and eval targets into original evaluation designs. Own the hard questions: construct validity, discrimination, headroom, and contamination. • Benchmark development. Build evaluation packages with subject-matter experts, each with expert-verified ground truth, multi-model headroom results, and rigorous QC (calibration layers, severity-weighted rubrics, deterministic verifiers). • Experts. Recruit, calibrate, and review a pool across coding, agentic/tool-use, and STEM/reasoning. Be the final arbiter of correctness and frontier difficulty. • Lab relationships. Be a technical point of contact for labs, with CEO support. Understand what they're trying to measure and translate it into an evaluation design. • Delivery. Turn lab requests into winning sample packages, then own pilots end to end. Nothing ships before it's lab-ready.

🎯 Requirements

• Research background in ML evaluation or benchmarking — published/open benchmarks, eval research, or equivalent hands-on work labs relied on. • Deep LLM benchmarking expertise, with real strength in code-model evaluation. • Fluency with how frontier models are measured: rubrics, pass rates, headroom, contamination, and what makes a task discriminate a model. • Proven ability to hold a team or expert pool to a rigorous standard. • Fluent English. Spanish a nice to have.

🏖️ Benefits

• Health insurance • Professional development opportunities

Apply Now