Software Engineer, Benchmarking

Job not on LinkedIn

πŸ•’ June 29

Where this job comes from

Posted on Epoch AI's careers page β†—Epoch AI's careers page, not through a job board

First seen by Remote Rocketship June 29

Still open on Epoch AI's site. Checked 4 hours ago.

Apply Now
Logo of Epoch AI

Epoch AI

11 - 50 employees

Founded 2022

πŸ’Ό Consulting

πŸ“£ Marketing

πŸ€– Artificial Intelligence

Consulting β€’ Marketing β€’ Artificial Intelligence

Epoch AI is a research and data organization that tracks and analyzes trends in artificial intelligence, maintaining open databases of AI models, data centers, hardware performance, chip sales, and benchmarking results. It publishes papers, reports, newsletters, podcasts, and data insights, and offers custom research and advisory services to policymakers, institutions, and companies to inform decisions about AI development, infrastructure, and governance.

πŸ“‹ Description

β€’ Implement benchmarks: Implement AI benchmarks within our evaluation infrastructure (primarily using the Inspect library) to expand the suite of capabilities we track. Develop our existing suite of benchmarks so we can quickly and painlessly evaluate new model releases. β€’ Develop new benchmarks: Contribute to the development of brand new benchmarks. You will have the opportunity to pitch and prototype your own ideas in addition to helping out with existing projects. β€’ Collaborate: Work closely with researchers, analysts, and other engineers at Epoch AI to ensure evaluation data and outputs are accurate, insightful, and effectively integrated into our research products and publications.

🎯 Requirements

β€’ Solid engineering skills: A strong software engineering background with more than two years of professional experience building and maintaining complex systems. You are expected to regularly contribute high-quality, robust, and maintainable code and be comfortable diving deep into existing codebases and infrastructure. β€’ Ideas and creativity: Candidates should be able to generate their own ideas for new benchmarks, experiments, novel things to try, and other projects. β€’ Mission-driven: You’re motivated by Epoch AI’s mission to provide rigorous, independent insight into key trends in AI. You want to deliver public, trustworthy evaluations of AI capabilities on challenging benchmarks, empowering researchers, policymakers, and the wider public to make well-informed decisions about AI. β€’ AI domain expertise or cybersecurity experience are strong pluses but not required.

πŸ–οΈ Benefits

β€’ Fully remote environment, including flexible work hours and schedules for most roles. β€’ Competitive global benefits program, including a comprehensive health insurance programβ€”including supplemental benefits specific to a local country, as available and mandated by local lawβ€”and life insurance and a pension plan, if applicable in your country. β€’ Generous paid time off (PTO), including no specific limit on PTO with 30 days per year protected, unlimited personal and sick leave, and up to 6 months (combination of paid + unpaid) parental leave for permanent staff. β€’ A flexible and generous expense policy for you to spend on equipment and a large range of productivity tools or learning/development opportunities you might find valuable, subject to regulations and manager approval. β€’ Paid work trips, including 3 staff retreats per year and relevant conferences. β€’ Access to our very well-equipped offices in Berkeley, California, including paid meals, snacks, gym, and more. All staff, independently of where they are based, have access to the office for at least 20 days each year.

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ June 29

ClickUp

1001 - 5000

☁️ SaaS

⚑ Productivity

🏒 Enterprise

Senior Software Engineer developing AI-native products and tooling for ClickUp, leveraging advanced AI infrastructure and collaborating with cross-functional teams.

πŸ•’ June 27

Netflix

10,000+ employees

πŸ“± Media

πŸ‘₯ B2C

Android Software Engineer managing software architecture and development for Netflix's Android app. Collaborating with cross-functional teams to improve product experiences worldwide.

πŸ•’ June 27

Parlance

51 - 200

πŸ₯ Healthcare

πŸ€– Artificial Intelligence

☁️ SaaS

Senior Software Engineer designing and implementing scalable software solutions for a speech technology company. Collaborating with teams to enhance caller experience using .NET and Azure technologies.

πŸ•’ June 26

Upstart

1001 - 5000

🚘 Automotive

πŸ’Ό Consulting

πŸ₯ Healthcare

Software Engineer II designing and building scalable backend services powering automated verification workflows for Upstart. Collaborating with cross-functional teams to improve automation and platform scalability.

πŸ•’ June 26

HHAeXchange

501 - 1000

πŸ₯ Healthcare

πŸ’Ό Consulting

πŸ“¦ Logistics

Senior Software Engineer contributing to backend services and solutions for HHAeXchange's caregiver platform. Enhancing healthcare technology and collaborating with cross-functional teams.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok