GenAI Safety Analyst

Job not on LinkedIn

🔥 0 minutes ago

🇺🇸 United States – Remote

💵 $80k - $87k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🧐 Analyst

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

ActiveFence

WebsiteLinkedInAll Job Openings

201 - 500 employees

🔒 Cybersecurity

🤖 Artificial Intelligence

💰 $400M Series B on 2021-07

Cybersecurity • Artificial Intelligence

ActiveFence is a Trust and Safety provider for online platforms, protecting platforms and their users from malicious behavior and content. Trust and Safety teams of all sizes rely on ActiveFence to keep their users safe from the widest spectrum of online harms, unwanted content, and malicious behavior, including child safety and exploitation, disinformation, hate speech, terror, nudity, fraud, and more. We offer a full stack of capabilities with our deep intelligence research, AI-driven harmful content detection, and online content moderation platform. Protecting over three billion users globally everyday in over 100 languages, ActiveFence lets people interact and thrive online.

📋 Description

• Analyze content infringements to help secure Generative AI tools • Collaborate with experts in Hate Speech, Misinformation, Intellectual Property, Copyright, and other abuse areas • Write adversarial prompts to identify weaknesses in LLMs, Text-to-Image, Text-to-Video, AI Agents, and other AI models • Oversee data management to ensure high-quality outputs • Develop adversarial and risky prompt strategies across abuse areas to expose model vulnerabilities • Manage projects end-to-end from planning and oversight through quality assurance to final delivery • Handle extensive datasets across multiple languages and abuse areas • Investigate new tactics for circumventing foundational models' safety measures • Work with engineering, product, and policy teams to address challenges and develop strategies and solutions • Promote knowledge exchange and continual learning within the team

🎯 Requirements

• Background in AI Safety and/or Responsible AI and/or Trust and Safety • Familiarity with recent Generative AI models and agents is essential • Command of English at a near-native level • Attention to detail • Organizational capabilities • Capacity to juggle numerous tasks concurrently • Experience with various model types (Text-to-Text, Text-to-Image) is desirable • Prior experience with OSINT (Open Source Intelligence) will be considered an asset • Self-starter attitude and energy to excel in a fast-moving and variable environment