Researcher, Evaluations and Benchmarks

Job not on LinkedIn

🔥 0 minutes ago

🗽 New York – Remote

🗽 New York – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

👻 Ghost score 10%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

ActiveFence

WebsiteLinkedInAll Job Openings

201 - 500 employees

🔒 Cybersecurity

🤖 Artificial Intelligence

💰 $400M Series B on 2021-07

Cybersecurity • Artificial Intelligence

ActiveFence is a Trust and Safety provider for online platforms, protecting platforms and their users from malicious behavior and content. Trust and Safety teams of all sizes rely on ActiveFence to keep their users safe from the widest spectrum of online harms, unwanted content, and malicious behavior, including child safety and exploitation, disinformation, hate speech, terror, nudity, fraud, and more. We offer a full stack of capabilities with our deep intelligence research, AI-driven harmful content detection, and online content moderation platform. Protecting over three billion users globally everyday in over 100 languages, ActiveFence lets people interact and thrive online.

📋 Description

• Ship a benchmark every two to three weeks measuring a previously unmeasured frontier risk • Collaborate with leading AI labs and universities on benchmarks and papers • Pair with in-house researchers who own specific harm areas and direct freelancers • Own the taxonomy, evaluation harness, quality bar, and release • Ensure frontier labs can rerun the benchmark and reproduce the reported numbers • Read evals, verify taxonomy alignment, and push researchers on quality • Own the benchmark plan and calendar and keep researchers on schedule • Direct two or three freelance subject matter experts as needed • Meet roughly monthly with the CTO, pod, and research leads to set the quarterly release roadmap • Tie the release plan to target accounts • Monitor the AI safety and security ecosystem, read research, maintain lab contacts, and gather feedback • Travel to conferences and speak with AI lab contacts weekly

🎯 Requirements

• PhD or Masters in computer science, machine learning or a related field, or equivalent depth from industry research • 3+ years building and running safety or security evaluations for language models in production, at an AI lab, a model provider, or a safety and security research organisation • 5+ relevant research publications in AI safety and security, including lead author on at least 2 • Strong engineering skills, including evaluation harnesses, distributed inference, vLLM, reading a codebase and fixing it • Ability to build a taxonomy, not only score against one • Ability to direct a researcher and two freelancers without formally managing them • Strong English, written and spoken • Curiosity about harms and ability to learn a new subject every three weeks • Post-training experience with SFT, DPO, or GRPO (ideally) • Reward design for subjective and safety-relevant targets (ideally) • Agentic evaluation experience with tool use, orchestration, permissions, and prompt injection (ideally) • Publications at top conferences (ideally) • Willingness to present work on client calls; strong verbal and written communication and ability to present to large and/or senior audiences (ideally)

🏖️ Benefits

• Budget for freelancers directed ad hoc when needed • Travel to conferences a couple of times a year • Travel to conferences at least 3 times a year (ideally)