Senior AI/LLM Penetration Tester

🕒 July 16

🇺🇸 United States – Remote

⏰ Full Time

🟠 Senior

🔧 QA Engineer (Quality Assurance)

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Bishop Fox

WebsiteLinkedInAll Job Openings

201 - 500 employees

Founded 2007

💼 Consulting

📦 Logistics

📣 Marketing

💰 $46M Series B on 2022-11

Consulting • Logistics • Marketing

Bishop Fox is a leader in offensive security, offering a range of continuous security solutions to protect dynamic attack surfaces. Their services include attack surface management, application penetration testing, cloud security assessments, network security, and more. They focus on proactive defense strategies, subjecting clients' networks to real-world attack scenarios to bolster security resilience. Bishop Fox collaborates with major partners like Google, Facebook, and Amazon, ensuring robust security solutions for complex ecosystems. Their commitment to advancing security is rooted in innovative research and collaboration with the broader cybersecurity community.

📋 Description

• Conduct cutting-edge security assessments of large language models, AI agents, and AI-powered applications. • Help clients stay ahead of emerging AI threats.

🎯 Requirements

• 5+ years of offensive security experience performing penetration tests, red team engagements, or application security assessments • Experience assessing AI/LLM-powered applications for vulnerabilities such as: Prompt injection, Jailbreak techniques, Indirect prompt injection, Data leakage and sensitive information disclosure, Insecure tool/function calling, Agentic AI abuse, Model misuse and unsafe output generation, Understanding of modern AI architectures, including: • Experience performing manual application security testing beyond automated scanning • Strong understanding of web application security fundamentals, including the OWASP Top 10 Web, Agentic, and LLM Applications. • Experience reviewing AI application architectures and identifying security weaknesses across APIs, cloud infrastructure, and application logic • Experience performing source code review and dynamic testing • Familiarity with cloud platforms (AWS, Azure, or GCP) and securing AI workloads • Scripting or programming experience in Python, JavaScript Go, Java, or similar languages • Familiarity with LLM application and agent-orchestration frameworks, inference provider APIs, external capability integration for models, and open source tooling across commercial and self-hosted ecosystems. • Knowledge of authentication, authorization, networking, APIs, and secure software development practices • Excellent written and verbal communication skills, including presenting findings to technical and executive audiences • Ability to mentor teammates and contribute to internal research, tooling, and methodology development • OSCP, OSEP, GWAPT, GPEN, GXPN, or other relevant certifications are helpful but not required • Bachelor's degree in Computer Science, Cybersecurity, or a related technical field is a plus

🏖️ Benefits

• Our comprehensive benefits program is tailored to meet your needs at an affordable price. • We embrace diversity and foster an inclusive culture where employees are empowered to do their best work while advancing the security community through world-class research and consulting.