Researcher, Evaluations and Benchmarks

Job not on LinkedIn

🔥 0 minutes ago

🇺🇸 United States – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

👻 Ghost score 10%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

ActiveFence

WebsiteLinkedInAll Job Openings

201 - 500 employees

🔒 Cybersecurity

🤖 Artificial Intelligence

💰 $400M Series B on 2021-07

Cybersecurity • Artificial Intelligence

ActiveFence is a Trust and Safety provider for online platforms, protecting platforms and their users from malicious behavior and content. Trust and Safety teams of all sizes rely on ActiveFence to keep their users safe from the widest spectrum of online harms, unwanted content, and malicious behavior, including child safety and exploitation, disinformation, hate speech, terror, nudity, fraud, and more. We offer a full stack of capabilities with our deep intelligence research, AI-driven harmful content detection, and online content moderation platform. Protecting over three billion users globally everyday in over 100 languages, ActiveFence lets people interact and thrive online.

📋 Description

• Ship a benchmark every two to three weeks measuring a previously unmeasured frontier risk • Collaborate with leading AI labs and universities on benchmarks and papers • Own the taxonomy, evaluation harness, quality bar, and release for each benchmark • Review evals personally and ensure verifiers, rubrics, distributions, and taxonomies meet quality standards • Hold the benchmark plan and calendar and keep researchers on timeline • Direct two or three ad-hoc SME freelancers • Set the quarterly release roadmap with the CTO, pod, and research leads based on research, client requests, and current events • Read relevant research and maintain relationships with AI labs • Speak with lab contacts weekly and attend conferences

🎯 Requirements

• PhD or Masters in computer science, machine learning or a related field, or equivalent depth from industry research • 3+ years building and running safety or security evaluations for language models in production, at an AI lab, a model provider, or a safety and security research organisation • 5+ relevant research publications in AI safety and security, including lead author on at least 2 • Strong engineering skills, including evaluation harnesses, distributed inference, vLLM, reading a codebase and fixing it • Ability to build a taxonomy, not only score against one • Ability to direct a researcher and two freelancers without formally managing them • Strong English, written and spoken • Curiosity about AI harms and ability to learn a new subject every three weeks • Ideally: post-training experience with SFT, DPO, and GRPO • Ideally: reward design for subjective and safety-relevant targets • Ideally: agentic evaluation experience with tool use, orchestration, permissions, and prompt injection • Ideally: publications at top conferences • Willingness to present work on client calls • Strong verbal and written communication and ability to present to large and/or senior audiences • Travel to conferences at least 3 times a year

🏖️ Benefits

• Travel to a couple of conferences a year • Travel to conferences at least 3 times a year • Opportunity to collaborate with leading AI labs and universities • Opportunity to work with approximately 150 researchers on AI harms • Role in the CTO office with access to research teams and freelancers