Research Scientist, Benchmarks & Evals

Job not on LinkedIn

🔥 0 minutes ago

🇺🇸 United States – Remote

💵 $150k - $250k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🧬 Research Scientist

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Kled AI

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2025

🤖 Artificial Intelligence

🏪 Marketplace

🤝 B2B

Artificial Intelligence • Marketplace • B2B

Kled AI is a research-backed data marketplace and mobile platform that sources, curates, and licenses opt-in human datasets to train and improve AI models. Through a contributor app that pays users for photos, videos, and other human-generated data, Kled aggregates high-utility, verifiable datasets for AI companies, governments, and research institutions, and publishes research demonstrating dataset improvements for model fidelity. The company focuses on solving AI data scarcity by combining marketplace services, contributor tools, automated quality checks, and enterprise-facing dataset products.

📋 Description

• Design and ship public benchmarks for image, video and document models • Build private test sets from real, opt-in data that no model has trained on • Run data-value experiments by training models with and without Kled data and measuring changes • Design human evaluation studies and automatic metrics • Publish leaderboards and reports trusted by researchers at frontier labs • Identify model shortcomings and advise what data to collect next • Work directly with founders and lab buyers to turn results into data deals

🎯 Requirements

• 3+ years ML research or research engineering experience • A benchmark or evaluation you built that other people actually used • Strong hands-on experience training and fine-tuning image or video models (PyTorch) • Deep understanding of experimental design and statistics (controls, ablations, human studies) • Experience running experiments end to end, from GPUs to final report • Clear writing for both researchers and buyers • Publications at NeurIPS, ICML, ICLR or CVPR (datasets and benchmarks especially) (bonus) • Experience on an evaluation or data team at an AI lab (bonus) • Experience selling or licensing data to AI labs (bonus) • Experience with data valuation or data attribution research (bonus) • Python / PyTorch • Open-weight image and video models • Cloud GPUs • PostgreSQL (Supabase) • S3 storage

🏖️ Benefits

• $350,000 – $750,000 equity • 0.25% – 1% equity