Software Engineer, Benchmarking

Vaga não está no LinkedIn

🕒 Junho 29

Candidatar-se

Encontrar Vagas Remotas Similares

Configurar Alerta de Email para Novas Vagas

📊 Verifique sua pontuação de currículo para esta vaga

Melhore suas chances de conseguir uma entrevista verificando sua pontuação de currículo antes de se candidatar.

Enviar Currículo

Epoch AI

SiteLinkedInTodas as Vagas

11 - 50 funcionários

Fundada em 2022

💼 Consultoria

📣 Marketing

🤖 Inteligência Artificial

Consulting • Marketing • Artificial Intelligence

Epoch AI é uma organização de pesquisa e dados que rastreia e analisa tendências em inteligência artificial, mantendo bancos de dados abertos de modelos de IA, data centers, desempenho de hardware, vendas de chips e resultados de benchmarks. A empresa publica artigos, relatórios, newsletters, podcasts e insights de dados, além de oferecer serviços de pesquisa personalizada e consultoria para formuladores de políticas, instituições e empresas, visando informar decisões sobre o desenvolvimento, infraestrutura e governança da IA.

Descrição

• Implement benchmarks: Implement AI benchmarks within our evaluation infrastructure (primarily using the Inspect library) to expand the suite of capabilities we track. Develop our existing suite of benchmarks so we can quickly and painlessly evaluate new model releases. • Develop new benchmarks: Contribute to the development of brand new benchmarks. You will have the opportunity to pitch and prototype your own ideas in addition to helping out with existing projects. • Collaborate: Work closely with researchers, analysts, and other engineers at Epoch AI to ensure evaluation data and outputs are accurate, insightful, and effectively integrated into our research products and publications.

🎯 Requisitos

• Solid engineering skills: A strong software engineering background with more than two years of professional experience building and maintaining complex systems. You are expected to regularly contribute high-quality, robust, and maintainable code and be comfortable diving deep into existing codebases and infrastructure. • Ideas and creativity: Candidates should be able to generate their own ideas for new benchmarks, experiments, novel things to try, and other projects. • Mission-driven: You’re motivated by Epoch AI’s mission to provide rigorous, independent insight into key trends in AI. You want to deliver public, trustworthy evaluations of AI capabilities on challenging benchmarks, empowering researchers, policymakers, and the wider public to make well-informed decisions about AI. • AI domain expertise or cybersecurity experience are strong pluses but not required.

🏖️ Benefícios

• Fully remote environment, including flexible work hours and schedules for most roles. • Competitive global benefits program, including a comprehensive health insurance program—including supplemental benefits specific to a local country, as available and mandated by local law—and life insurance and a pension plan, if applicable in your country. • Generous paid time off (PTO), including no specific limit on PTO with 30 days per year protected, unlimited personal and sick leave, and up to 6 months (combination of paid + unpaid) parental leave for permanent staff. • A flexible and generous expense policy for you to spend on equipment and a large range of productivity tools or learning/development opportunities you might find valuable, subject to regulations and manager approval. • Paid work trips, including 3 staff retreats per year and relevant conferences. • Access to our very well-equipped offices in Berkeley, California, including paid meals, snacks, gym, and more. All staff, independently of where they are based, have access to the office for at least 20 days each year.