Research Scientist, Benchmarks & Evals

🕒 October 11

🇺🇸 United States – Remote

💵 $250k - $350k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🧬 Research Scientist

👻 Ghost score 12%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Kled AI

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2025

🤖 Artificial Intelligence

🏪 Marketplace

🤝 B2B

Artificial Intelligence • Marketplace • B2B

Kled AI is a research-backed data marketplace and mobile platform that sources, curates, and licenses opt-in human datasets to train and improve AI models. Through a contributor app that pays users for photos, videos, and other human-generated data, Kled aggregates high-utility, verifiable datasets for AI companies, governments, and research institutions, and publishes research demonstrating dataset improvements for model fidelity. The company focuses on solving AI data scarcity by combining marketplace services, contributor tools, automated quality checks, and enterprise-facing dataset products.

📋 Description

• Design and ship public benchmarks for image, video, and document models • Build private test sets from real, opt-in data that no model has trained on • Run data-value experiments by training models with and without Kled data and measuring the differences • Design human evaluation studies and automatic metrics • Publish trusted leaderboards and reports for frontier AI researchers • Identify model shortcomings and advise the team on what data to collect next • Work directly with founders and lab buyers to turn results into data deals • Operate at the frontier of applied AI data infrastructure • Build systems handling millions of uploads per day, adversarial environments, and global contributors

🎯 Requirements

• 5-7+ years ML research or research engineering experience • A benchmark or evaluation you built that other people actually used • Strong hands-on experience training and fine-tuning image or video models using PyTorch • Deep understanding of experimental design and statistics, including controls, ablations, and human studies • Experience running experiments end to end, from GPUs to final report • Clear writing for both researchers and buyers • Publications at NeurIPS, ICML, ICLR, or CVPR, especially datasets and benchmarks (bonus) • Experience on an evaluation or data team at an AI lab (bonus) • Experience selling or licensing data to AI labs (bonus) • Experience with data valuation or data attribution research (bonus) • Python/PyTorch proficiency • Experience with open-weight image and video models • Experience with cloud GPUs • Experience with PostgreSQL (Supabase) • Experience with S3 storage

🏖️ Benefits

• $750,000–$1,500,000 equity • Opportunity to work directly with founders and AI lab buyers • Opportunity to own core systems powering a large human data network • Opportunity to design infrastructure influencing next-generation AI training data • Opportunity to build at scale with millions of uploads per day and global contributors • Opportunity to ship alongside a team experienced in marketplaces, AI systems, and products used by millions

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume