Research Scientist, Benchmarks & Evals

πŸ•’ October 11

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $250k - $350k / year

⏰ Full Time

🟑 Mid-level

🟠 Senior

🧬 Research Scientist

Where this job comes from

Posted on Kled AI's careers page β†—Kled AI's careers page, not through a job board

First seen by Remote Rocketship October 11

Still open on Kled AI's site. Checked 5 hours ago.

Apply Now
Logo of Kled AI

Kled AI

11 - 50 employees

Founded 2025

πŸ€– Artificial Intelligence

πŸͺ Marketplace

🀝 B2B

Artificial Intelligence β€’ Marketplace β€’ B2B

Kled AI is a research-backed data marketplace and mobile platform that sources, curates, and licenses opt-in human datasets to train and improve AI models. Through a contributor app that pays users for photos, videos, and other human-generated data, Kled aggregates high-utility, verifiable datasets for AI companies, governments, and research institutions, and publishes research demonstrating dataset improvements for model fidelity. The company focuses on solving AI data scarcity by combining marketplace services, contributor tools, automated quality checks, and enterprise-facing dataset products.

πŸ“‹ Description

β€’ Design and ship public benchmarks for image, video, and document models β€’ Build private test sets from real, opt-in data that no model has trained on β€’ Run data-value experiments by training models with and without Kled data and measuring the differences β€’ Design human evaluation studies and automatic metrics β€’ Publish trusted leaderboards and reports for frontier AI researchers β€’ Identify model shortcomings and advise the team on what data to collect next β€’ Work directly with founders and lab buyers to turn results into data deals β€’ Operate at the frontier of applied AI data infrastructure β€’ Build systems handling millions of uploads per day, adversarial environments, and global contributors

🎯 Requirements

β€’ 5-7+ years ML research or research engineering experience β€’ A benchmark or evaluation you built that other people actually used β€’ Strong hands-on experience training and fine-tuning image or video models using PyTorch β€’ Deep understanding of experimental design and statistics, including controls, ablations, and human studies β€’ Experience running experiments end to end, from GPUs to final report β€’ Clear writing for both researchers and buyers β€’ Publications at NeurIPS, ICML, ICLR, or CVPR, especially datasets and benchmarks (bonus) β€’ Experience on an evaluation or data team at an AI lab (bonus) β€’ Experience selling or licensing data to AI labs (bonus) β€’ Experience with data valuation or data attribution research (bonus) β€’ Python/PyTorch proficiency β€’ Experience with open-weight image and video models β€’ Experience with cloud GPUs β€’ Experience with PostgreSQL (Supabase) β€’ Experience with S3 storage

πŸ–οΈ Benefits

β€’ $750,000–$1,500,000 equity β€’ Opportunity to work directly with founders and AI lab buyers β€’ Opportunity to own core systems powering a large human data network β€’ Opportunity to design infrastructure influencing next-generation AI training data β€’ Opportunity to build at scale with millions of uploads per day and global contributors β€’ Opportunity to ship alongside a team experienced in marketplaces, AI systems, and products used by millions

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ October 9

Praxis

11 - 50

πŸ₯ Healthcare

πŸ’Ό Consulting

πŸ“¦ Logistics

Principal Scientist leading drug-substance process chemistry for Praxis, a clinical-stage CNS biopharmaceutical company. Driving development, manufacturing strategy, CRO/CDMO execution, and regulatory submissions.

πŸ•’ October 9

Praxis

11 - 50

πŸ₯ Healthcare

πŸ’Ό Consulting

πŸ“¦ Logistics

Principal Scientist leading drug formulation and manufacturing development at Praxis, a clinical-stage CNS biopharmaceutical company. Guiding clinical programs, CDMOs, and CMC regulatory submissions.

πŸ•’ October 9

Dechra

1001 - 5000

πŸ’Š Pharmaceuticals

πŸ₯ Healthcare

Senior Principal Scientist shaping US regulatory strategy for Dechra’s veterinary drugs and biologics. Guiding FDA/USDA submissions, product approvals, and regulatory innovation.

πŸ•’ October 7

Zillow

5001 - 10000

🏠 Real Estate

πŸ›οΈ eCommerce

πŸ‘₯ B2C

Applied Scientist developing econometric and machine-learning housing forecasts for Zillow. Building regional models, production forecasts, and market stress-testing scenarios.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $132.4k - $222.6k / year

πŸ’° $4.1M Post-IPO Equity on 2012-12

⏰ Full Time

🟒 Junior

🟑 Mid-level

🧬 Research Scientist

πŸ•’ October 2

GondolaBio

11 - 50

πŸ₯ Healthcare

πŸ’Ό Consulting

🏭 Manufacturing

Principal Scientist advancing GondolaBio’s genetic-disease therapeutics through in vivo neurology pharmacology. Designing rodent and primate studies toward IND submission and dose-selection decisions.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $173k - $205k / year

πŸ’° $300M Venture Round - GondolaBio on 2024-08

⏰ Full Time

🟠 Senior

πŸ”΄ Lead

🧬 Research Scientist

Developed byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok