AI Red Teamer, CBRNE

πŸ•’ September 5

Where this job comes from

Posted on Handshake's careers page β†—Handshake's careers page, not through a job board

First seen by Remote Rocketship September 5

Still open on Handshake's site. Checked 6 hours ago.

Apply Now
Logo of Handshake

Handshake

501 - 1000 employees

Founded 2014

πŸ’Ό Consulting

πŸ₯ Healthcare

πŸ“¦ Logistics

Consulting β€’ Healthcare β€’ Logistics

Handshake is a platform that connects students with potential employers and career centers, offering tools to streamline the recruiting process for its users. It provides features such as job postings, talent engagement suites, and event management for both virtual and in-person recruiting events. Handshake is widely used by Fortune 100 companies and offers integrations with existing automated tracking systems. It aims to build early career networks and supports a diverse range of Gen Z talent with a focus on improving hiring outcomes through proprietary data and advanced recruiting strategies.

πŸ“‹ Description

β€’ Evaluate whether AI models appropriately handle queries related to chemical, biological, radiological, nuclear, and explosive threats β€’ Design technically grounded adversarial prompts testing whether models provide meaningful uplift toward CBRNE threats β€’ Evaluate model outputs for technical accuracy and dangerous information β€’ Probe dual-use knowledge boundaries involving scientific, medical, industrial, and weapons applications β€’ Test multi-step and multi-turn attack chains β€’ Score model responses against structured harm taxonomies and severity rubrics β€’ Document findings with clear technical reasoning β€’ Distinguish open-literature information from genuine operational uplift β€’ Contribute to CBRNE-specific evaluation frameworks and threat models β€’ Collaborate with red teamers, AI researchers, and policy teams to translate findings into model improvements β€’ Stay current on model capabilities, jailbreak techniques, and relevant domain developments

🎯 Requirements

β€’ Graduate-level education or equivalent professional experience in a relevant CBRNE field (chemistry, biochemistry, microbiology, virology, nuclear physics, radiochemistry, materials science, munitions/ordnance, chemical engineering, or closely related disciplines) β€’ Ability to evaluate the technical accuracy and real-world consequence of model outputs in your domain β€’ Understanding of dual-use research concerns and the distinction between open-source knowledge and operationally significant uplift β€’ Strong hands-on experience using multiple LLMs (ChatGPT, Claude, Gemini, open-source models, etc.) β€’ Creative, adversarial problem-solving skills β€’ Clear and precise written communication, including the ability to explain technical risk to non-specialist audiences β€’ Strong ethical judgment and the ability to separate adversarial thinking from personal values β€’ Self-directed, collaborative, and comfortable in feedback-heavy environments β€’ Candidates must be able to engage with sensitive CBRNE-related material professionally and sustainably β€’ Active or prior security clearance (Secret, Top Secret, or SCI) (nice to have) β€’ Experience in threat assessment, WMD analysis, intelligence analysis, or arms control verification (nice to have) β€’ Background in biosafety/biosecurity, chemical safety, nuclear nonproliferation, or explosive ordnance disposal (nice to have) β€’ Familiarity with relevant regulatory frameworks including CWC, BWC, IAEA safeguards, ATF regulations, and Export Administration Regulations (nice to have) β€’ Experience in red teaming, penetration testing, or structured adversarial evaluation (nice to have) β€’ Familiarity with Python or scripting languages, LLM APIs, or evaluation tooling (nice to have) β€’ Published research or professional presentations in a relevant CBRNE domain (nice to have) β€’ Prior work in trust and safety, content moderation, or AI evaluation (nice to have)

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ August 14

Aptura

1 - 1

πŸ€– Artificial Intelligence

πŸ₯ Healthcare

πŸ’Έ Finance

Physicians reviewing clinical outputs and designing safety-focused evaluation tasks for frontier AI models. Asynchronous specialty-based work validating answers, grading criteria, and clinical risk across global regions.

πŸ•’ August 14

Improvado

51 - 200

πŸ“£ Marketing

πŸ’Ό Consulting

☁️ SaaS

Senior AI Analyst automating marketing data workflows for Improvado's unified marketing intelligence platform. Delivering SQL DataMarts, pipelines, and AI-driven analytics solutions for enterprise clients.

πŸ•’ August 6

Terac

1 - 10

πŸ€– Artificial Intelligence

🀝 B2B

STEM experts creating graduate-to-PhD-level problems and exact solutions for Terac’s AI training research. Reviewing AI responses and identifying scientific reasoning errors.

πŸ•’ August 2

Sunshine Enterprise USA

51 - 200

🎯 Recruiter

πŸ‘₯ HR Tech

🀝 B2B

AI Consultant leading enterprise AI initiatives focused on evaluating, designing, and implementing AI solutions. Collaborating with stakeholders and ensuring compliance with governance and security standards.

πŸ•’ July 29

Benchmark Insurance Group

2 - 10

πŸ›‘οΈ Insurance

🀝 B2B

AI Workflow Architect designing and building automation systems for insurance and real estate operations. Deploying end-to-end AI workflows and collaborating with leadership to optimize processes.

Developed byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok