AI Red Teamer – LLM Generalist

🔥 7 minutes ago

🇺🇸 United States – Remote

💵 $32 - $95 / hour

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Handshake

WebsiteLinkedInAll Job Openings

501 - 1000 employees

Founded 2014

💼 Consulting

🏥 Healthcare

📦 Logistics

Consulting • Healthcare • Logistics

Handshake is a platform that connects students with potential employers and career centers, offering tools to streamline the recruiting process for its users. It provides features such as job postings, talent engagement suites, and event management for both virtual and in-person recruiting events. Handshake is widely used by Fortune 100 companies and offers integrations with existing automated tracking systems. It aims to build early career networks and supports a diverse range of Gen Z talent with a focus on improving hiring outcomes through proprietary data and advanced recruiting strategies.

📋 Description

• Stress-test large language models by intentionally trying to break them • Design creative, adversarial prompts exposing unsafe content, bias, broken guardrails, hallucinations, prompt injection weaknesses, and unexpected behaviors • Probe models across content safety, CBRN, cybersecurity, persuasion and influence operations, child safety, self-harm, over-companionship, and regulatory compliance • Test text, image, voice, and agentic model capabilities as project needs require • Craft multi-turn scenarios to stress-test AI guardrails • Discover ways around safety filters, restrictions, and defenses using jailbreak, evasion, and prompt injection techniques • Explore edge cases to provoke disallowed, harmful, or incorrect outputs • Evaluate and score model responses against structured harm taxonomies and severity rubrics • Document experiments, including methods, rationale, and findings • Review and refine adversarial prompts from other team members • Contribute to harm taxonomy development, calibration exercises, and inter-rater reliability work • Collaborate with engineers, data scientists, and researchers to share findings and strengthen defenses • Work regularly with potentially disturbing content • Stay current on jailbreaks, attack methods, and evolving model behaviors • Support Handshake AI's work partnering with leading AI research labs to make models safer and more robust

🎯 Requirements

• Strong hands-on experience using multiple LLMs, including ChatGPT, Claude, Gemini, and open-source models • Intuition for crafting adversarial prompts; familiarity with jailbreak or evasion techniques is a strong plus • Creative, adversarial problem-solving skills • Clear and thoughtful written communication • Strong ethical judgment and ability to separate adversarial thinking from personal values • Self-directed, collaborative, and comfortable in feedback-heavy environments • Curiosity, persistence, and comfort with frequent failure in experimentation • Candidates must be able to engage with harmful material professionally and sustainably • Familiarity with Python or other scripting languages • Experience working with LLM APIs or evaluation tooling • Comfort with structured data annotation and rubric-based scoring • Prior work in trust and safety, content moderation, QA, or security research • Subject matter expertise in a high-risk domain such as cybersecurity, chemistry, biology, medicine, law, or finance • Ability to work remotely from the United States, Monday through Friday, 40 hours per week • Must be authorized to work lawfully in the United States for Handshake • Must not require employment visa sponsorship, as addressed in the application requirements

🏖️ Benefits

• Support resources are available for exposure to disturbing content • Cash compensation range of $32–$95 per hour • Remote work from the United States • 40 hours per week