GenAI Safety Analyst

Job not on LinkedIn

🕒 July 28

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

ActiveFence

WebsiteLinkedInAll Job Openings

201 - 500 employees

🔒 Cybersecurity

🤖 Artificial Intelligence

💰 $400M Series B on 2021-07

Cybersecurity • Artificial Intelligence

ActiveFence is a Trust and Safety provider for online platforms, protecting platforms and their users from malicious behavior and content. Trust and Safety teams of all sizes rely on ActiveFence to keep their users safe from the widest spectrum of online harms, unwanted content, and malicious behavior, including child safety and exploitation, disinformation, hate speech, terror, nudity, fraud, and more. We offer a full stack of capabilities with our deep intelligence research, AI-driven harmful content detection, and online content moderation platform. Protecting over three billion users globally everyday in over 100 languages, ActiveFence lets people interact and thrive online.

📋 Description

• Analyzing various content infringements to secure Generative AI tools • Collaborating with experts in diverse fields such as Hate Speech, Misinformation, Intellectual Property and Copyright • Writing adversarial prompts to identify weaknesses in AI models • Overseeing data management to guarantee the highest quality of outputs • Managing projects end-to-end, from initial planning through quality assurance to final delivery • Handling extensive datasets across multiple languages and areas of abuse • Ongoing investigation into new tactics for circumventing foundational models' safety measures • Promoting a culture of knowledge exchange and continual learning within the team

🎯 Requirements

• Background in AI Safety and/or Responsible AI and/or Trust and Safety • Familiarity with recent Generative AI models and agents is essential, though direct technical experience is not a prerequisite • Command of English at a near-native level • Attention to detail, organizational capabilities, and the capacity to juggle numerous tasks concurrently • Experience with various model types (Text-to-Text, Text-to-Image) is desirable • Prior experience with OSINT (Open Source Intelligence) will be considered an asset • A self-starter attitude, with the energy to excel in a fast-moving and variable environment