Software Engineer, Cybersecurity Benchmarks

Job not on LinkedIn

🔥 2 minutes ago

🇺🇸 United States – Remote

💵 $150k - $350k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🧑‍💻 Full-stack Engineer

👻 Ghost score 14%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.Why this score:

• Just posted.
• Jobs at this company usually fill in 30 days.

Apply Now

Find Similar Remote Jobs

Epoch AI

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2022

💼 Consulting

📣 Marketing

🤖 Artificial Intelligence

Consulting • Marketing • Artificial Intelligence

Epoch AI is a research and data organization that tracks and analyzes trends in artificial intelligence, maintaining open databases of AI models, data centers, hardware performance, chip sales, and benchmarking results. It publishes papers, reports, newsletters, podcasts, and data insights, and offers custom research and advisory services to policymakers, institutions, and companies to inform decisions about AI development, infrastructure, and governance.

📋 Description

• Build and maintain cybersecurity benchmarks for AI within evaluation infrastructure, primarily using the Inspect library • Pitch and prototype ideas for new benchmarks and experiments • Keep the benchmark suite running so new model releases can be evaluated quickly • Sandbox and harden evaluation environments against highly capable AI models • Monitor how AI agents and coding harnesses interact with environments • Use threat modelling to inform benchmarking approaches and measurement decisions • Provide strategic input on AI cybersecurity evaluation strategy • Integrate with AI providers and configure benchmarks to run on infrastructure • Collaborate with researchers, analysts, and engineers to ensure evaluation data and outputs are accurate, insightful, and integrated into research products and publications • Report to the CTO

🎯 Requirements

• Strong software engineering experience, including several years building and maintaining complex systems and regularly contributing robust, maintainable code • Experience sandboxing software against highly capable adversaries • Red team experience ethically hacking software • Familiarity with agentic AI use and coding harnesses • Ability to generate ideas for new benchmarks and experiments • Motivation from Epoch AI’s mission to provide rigorous, independent insight into key trends in AI • Professional level English proficiency • Applications must be submitted in English • Experience benchmarking AIs and running evaluations (nice-to-have) • Experience setting up CTF infrastructure (nice-to-have) • Experience using modern AI for red teaming or ethically hacking (nice-to-have) • Knowledge of the inner workings of AI coding harnesses and tool calls (nice-to-have) • Familiarity with inspect_ai (nice-to-have) • Solid grasp of current AI trends (nice-to-have)

🏖️ Benefits

• Fully remote work • Full-time, flexible work hours • No required travel • Preference for candidates able to travel to three retreats per year • Inclusive, equitable, and supportive community • Accessibility support and application deadline extension requests

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume