AI Safety Specialist, English, Swedish

Job not on LinkedIn

🔥 0 minutes ago

🗽 New York – Remote

🗽 New York – Remote

💵 $45 - $60 / hour

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

24-MAG

WebsiteLinkedInAll Job Openings

2 - 10 employees

🤝 B2B

💼 Consulting

B2B • Consulting

24-MAG is a commercial strategy and execution firm that helps B2B organizations design and implement systems, workflows, and operating rhythms for sales, client management, and cross-functional projects. They focus on transforming scattered processes into aligned, measurable, and scalable commercial functions—covering pipeline structure, account management frameworks, and operational discipline for teams seeking efficient, intentional growth.

📋 Description

• Conduct adversarial testing of conversational AI models and agents • Develop jailbreaks, prompt-injection scenarios, misuse cases, and multi-turn manipulation strategies • Probe models for vulnerabilities missed by automated evaluation systems • Test model behaviour across diverse conversational and adversarial scenarios • Apply systematic testing frameworks and established evaluation methodologies • Identify and classify model failures and safety vulnerabilities • Evaluate bias, misinformation, misuse, and potentially harmful model behaviours • Identify recurring or systemic patterns across model responses • Assess severity, reproducibility, and practical significance of vulnerabilities • Produce high-quality human evaluation data from red teaming activities • Annotate model failures and categorise vulnerabilities • Create structured attack cases and supporting evaluation materials • Maintain consistency across repeated assessments and datasets • Document adversarial scenarios clearly and reproducibly • Produce reports, datasets, and structured findings for technical teams • Explain identified risks to technical and non-technical stakeholders • Record testing methodology, model behaviour, and relevant failure patterns • Contribute to broader evaluation coverage across models and use cases

🎯 Requirements

• Native-level fluency in both English and Swedish is required • Prior experience with AI red teaming, adversarial AI evaluation, cybersecurity, or socio-technical system testing • Strong understanding of conversational AI systems and model failure modes • Experience developing structured adversarial tests and evaluation frameworks • Ability to identify subtle vulnerabilities and recurring behavioural patterns • Strong analytical reasoning and written communication skills • Ability to document findings clearly and reproducibly • Comfort working across changing projects, scenarios, and evaluation frameworks • Background in computer science, cybersecurity, artificial intelligence, machine learning, linguistics, behavioural science, or a related discipline may be helpful • Equivalent professional experience in AI safety, adversarial testing, security, or structured model evaluation may also be considered • Practical red teaming experience is particularly valuable • Familiarity with adversarial machine learning • Knowledge of RLHF, DPO, model extraction, or related AI training and evaluation concepts • Cybersecurity experience involving penetration testing, exploit development, or reverse engineering • Experience testing conversational AI systems • Native-level English and Swedish proficiency required for the engagement • Work is as an independent contractor

🏖️ Benefits

• Fully remote work • Flexible scheduling • Competitive hourly compensation • Weekly payments via Stripe or Wise • Participation in higher-sensitivity projects is optional • Flexible remote consulting work • Projects may be extended, shortened, or adjusted depending on scope and performance