AI Red Teamer, CBRNE

🕒 September 5

🇺🇸 United States – Remote

💵 $65 - $158 / hour

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

Where this job comes from

Posted on Handshake's careers page ↗Handshake's careers page, not through a job board

First seen by Remote Rocketship September 5

Still open on Handshake's site. Checked 9 hours ago.

Apply Now
Logo of Handshake

Handshake

501 - 1000 employees

Founded 2014

💼 Consulting

🏥 Healthcare

📦 Logistics

Consulting • Healthcare • Logistics

Handshake is a platform that connects students with potential employers and career centers, offering tools to streamline the recruiting process for its users. It provides features such as job postings, talent engagement suites, and event management for both virtual and in-person recruiting events. Handshake is widely used by Fortune 100 companies and offers integrations with existing automated tracking systems. It aims to build early career networks and supports a diverse range of Gen Z talent with a focus on improving hiring outcomes through proprietary data and advanced recruiting strategies.

📋 Description

• Evaluate whether AI models appropriately handle queries related to chemical, biological, radiological, nuclear, and explosive threats • Design technically grounded adversarial prompts testing whether models provide meaningful uplift toward CBRNE threats • Evaluate model outputs for technical accuracy and dangerous information • Probe dual-use knowledge boundaries involving scientific, medical, industrial, and weapons applications • Test multi-step and multi-turn attack chains • Score model responses against structured harm taxonomies and severity rubrics • Document findings with clear technical reasoning • Distinguish open-literature information from genuine operational uplift • Contribute to CBRNE-specific evaluation frameworks and threat models • Collaborate with red teamers, AI researchers, and policy teams to translate findings into model improvements • Stay current on model capabilities, jailbreak techniques, and relevant domain developments

🎯 Requirements

• Graduate-level education or equivalent professional experience in a relevant CBRNE field (chemistry, biochemistry, microbiology, virology, nuclear physics, radiochemistry, materials science, munitions/ordnance, chemical engineering, or closely related disciplines) • Ability to evaluate the technical accuracy and real-world consequence of model outputs in your domain • Understanding of dual-use research concerns and the distinction between open-source knowledge and operationally significant uplift • Strong hands-on experience using multiple LLMs (ChatGPT, Claude, Gemini, open-source models, etc.) • Creative, adversarial problem-solving skills • Clear and precise written communication, including the ability to explain technical risk to non-specialist audiences • Strong ethical judgment and the ability to separate adversarial thinking from personal values • Self-directed, collaborative, and comfortable in feedback-heavy environments • Candidates must be able to engage with sensitive CBRNE-related material professionally and sustainably • Active or prior security clearance (Secret, Top Secret, or SCI) (nice to have) • Experience in threat assessment, WMD analysis, intelligence analysis, or arms control verification (nice to have) • Background in biosafety/biosecurity, chemical safety, nuclear nonproliferation, or explosive ordnance disposal (nice to have) • Familiarity with relevant regulatory frameworks including CWC, BWC, IAEA safeguards, ATF regulations, and Export Administration Regulations (nice to have) • Experience in red teaming, penetration testing, or structured adversarial evaluation (nice to have) • Familiarity with Python or scripting languages, LLM APIs, or evaluation tooling (nice to have) • Published research or professional presentations in a relevant CBRNE domain (nice to have) • Prior work in trust and safety, content moderation, or AI evaluation (nice to have)

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 September 2

Terac

1 - 10

🤖 Artificial Intelligence

🤝 B2B

AI evaluator reviewing shopping-assistant interactions for Terac, which connects vetted human experts with AI researchers and product teams. Creating rubrics to improve response quality.

🇺🇸 United States – Remote

💵 $50 / hour

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🕒 August 27

Welo Global

1001 - 5000

🤖 Artificial Intelligence

🤝 B2B

☁️ SaaS

Generative AI Analyst evaluating and annotating AI-generated content for Welo Data, a global AI data company. Reviewing multilingual data quality and providing structured feedback.

🇺🇸 United States – Remote

💵 $15 / hour

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🗣️🇨🇳 Chinese Required

🕒 August 14

Welo Global

1001 - 5000

🤖 Artificial Intelligence

🤝 B2B

☁️ SaaS

Generative AI Analyst reviewing US Spanish content for Welo Data’s AI training systems. Annotating multimedia data, conducting quality checks, and improving guidelines for next-generation generative AI.

🇺🇸 United States – Remote

💵 $15 / hour

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🗣️🇪🇸 Spanish Required

🕒 August 14

Aptura

1 - 1

🤖 Artificial Intelligence

🏥 Healthcare

💸 Finance

Physicians reviewing clinical outputs and designing safety-focused evaluation tasks for frontier AI models. Asynchronous specialty-based work validating answers, grading criteria, and clinical risk across global regions.

🇺🇸 United States – Remote

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🕒 August 14

Improvado

51 - 200

📣 Marketing

💼 Consulting

☁️ SaaS

Senior AI Analyst automating marketing data workflows for Improvado's unified marketing intelligence platform. Delivering SQL DataMarts, pipelines, and AI-driven analytics solutions for enterprise clients.

🇺🇸 United States – Remote

💰 $22M Series A - Improvado on 2022-05

⏳ Contract/Temporary

🟠 Senior

🤖 Artificial Intelligence

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok