Researcher – Benchmark Reviews

Job not on LinkedIn

🕒 July 3

🇺🇸 United States – Remote

💵 $100k - $200k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

Where this job comes from

Posted on Epoch AI's careers page ↗Epoch AI's careers page, not through a job board

First seen by Remote Rocketship July 3

Still open on Epoch AI's site. Checked 11 hours ago.

Apply Now
Logo of Epoch AI

Epoch AI

11 - 50 employees

Founded 2022

💼 Consulting

📣 Marketing

🤖 Artificial Intelligence

Consulting • Marketing • Artificial Intelligence

Epoch AI is a research and data organization that tracks and analyzes trends in artificial intelligence, maintaining open databases of AI models, data centers, hardware performance, chip sales, and benchmarking results. It publishes papers, reports, newsletters, podcasts, and data insights, and offers custom research and advisory services to policymakers, institutions, and companies to inform decisions about AI development, infrastructure, and governance.

📋 Description

• Review benchmarks: Assess a new benchmark at least every two weeks. You’ll evaluate their methodology and what a 'good performance' would imply about AI capabilities. • Publish and maintain reports: Write up public-facing reports on new benchmarks and periodically update them as new versions release and models make progress. • Dig into data: Examine individual tasks within benchmarks in detail, using coding agents to assist while retaining your own critical oversight.

🎯 Requirements

• You excel at written communication. Your first drafts rarely need much polishing; they’re clear and publication-quality with minimal revision. • You think critically about research methodologies. You have strong opinions about what benchmarks and evaluations should look like, and can recognize when something seems wrong. • You’re already familiar with existing AI benchmarks, their methodologies, strengths, and weaknesses. You have ideas for new benchmarks that don’t exist yet, but should. • You’re comfortable working with dense data. You’ll often be breaking down benchmarks into their component parts, which can be overwhelming without familiarity. • Experience writing about AI/ML for a public or research audience is nice to have. • Hands-on experience running or building AI evaluations is nice to have.

🏖️ Benefits

• Annual salary between $100,000 and $200,000 USD, depending on location, seniority, and experience. • Salaries are not restricted to USD, and contracts and payments are usually in local currencies. • Fully remote environment, including flexible work hours. • Competitive global benefits program, including a comprehensive health insurance program—including supplemental benefits specific to a local country, as available and mandated by local law—and life insurance and a pension plan, if applicable in your country. • Generous paid time off (PTO), including no specific annual limit, with 30 days PTO per year protected, unlimited personal and sick leave, and 4 months paid parental leave for permanent staff with at least 12 months of tenure. • A flexible and generous expense policy for you to spend on equipment and a large range of productivity tools or learning/development opportunities, including unlimited spending on AI tools, subject to regulations and manager approval. • Paid work trips, including 3 staff retreats per year and relevant conferences. • Access to our very well-equipped offices in Berkeley, California, including paid meals, snacks, gym, and more.

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 June 24

Falcon Finance

11 - 50

₿ Crypto

💸 Finance

Quantitative Researcher developing systematic trading strategies across the crypto asset space. Designing signals and conducting research in DeFi and CEX markets.

🇺🇸 United States – Remote

🔥 Funding within the last year

💰 $10M Series unknown on 2025-11

⏰ Full Time

🟠 Senior

🕒 June 24

GiveWell

51 - 200

🤲 Charity

🤝 Non-profit

🌍 Social Impact

Senior Nutrition Researcher at GiveWell focusing on cost-effective nutrition interventions globally. Leading research agendas and shaping grantmaking decisions to improve lives.

🕒 June 24

GiveWell

51 - 200

🤲 Charity

🤝 Non-profit

🌍 Social Impact

Senior Livelihoods Researcher identifying and funding cost-effective ways to improve living standards among the global poor. Joining a small grantmaking team with rigorous research agendas.

🕒 June 24

GiveWell

51 - 200

🤲 Charity

🤝 Non-profit

🌍 Social Impact

Senior Malaria Researcher at GiveWell focusing on global health and malaria research agenda. Contributing to rigorous agenda, communicating findings, and mentoring team members.

🕒 June 24

GiveWell

51 - 200

🤲 Charity

🤝 Non-profit

🌍 Social Impact

Senior Vaccination Researcher for GiveWell, directing funds to cost-effective vaccination programs. Join a small grantmaking team to influence global health outcomes with rigorous research.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok