
11 - 50 employees
Founded 2023
🤖 Artificial Intelligence
🔌 API
🏢 Enterprise
💰 Seed on 2023-07
Artificial Intelligence • API • Enterprise
LiteLLM AI Gateway is a self-hosted, air-gapped gateway product that centralizes and controls access to large language models, agents, and model-controlling platforms for platform teams. It exposes a single OpenAI-compatible API and single login (SSO) to route requests to 140+ providers and 1,800+ models, manage keys and secret managers, enforce governance, observe and optimize costs and usage, and enable swapping backend models without code changes. The product emphasizes enterprise features like access controls, routing, observability, cost caps, and day-zero support for new models, enabling organizations to bring internal, fine-tuned, and self-hosted models behind one key.
🕒 July 28
🇺🇸 United States – Remote
💵 $220k - $260k / year
⏰ Full Time
🟠 Senior
👮♂️ Cybersecurity / Security Engineer
👻 Ghost score 42%
Where this job comes from
Posted on LiteLLM AI Gateway's careers page, not through a job board
First seen by Remote Rocketship July 28
Still open on LiteLLM AI Gateway's site. Checked 2 hours ago.

11 - 50 employees
Founded 2023
🤖 Artificial Intelligence
🔌 API
🏢 Enterprise
💰 Seed on 2023-07
Artificial Intelligence • API • Enterprise
LiteLLM AI Gateway is a self-hosted, air-gapped gateway product that centralizes and controls access to large language models, agents, and model-controlling platforms for platform teams. It exposes a single OpenAI-compatible API and single login (SSO) to route requests to 140+ providers and 1,800+ models, manage keys and secret managers, enforce governance, observe and optimize costs and usage, and enable swapping backend models without code changes. The product emphasizes enterprise features like access controls, routing, observability, cost caps, and day-zero support for new models, enabling organizations to bring internal, fine-tuned, and self-hosted models behind one key.
• Conduct deep security reviews of LiteLLM’s Python proxy, APIs, authentication systems, and enterprise features • Identify and remediate vulnerabilities involving authentication, authorization, secrets, tenant isolation, injection, and data exposure • Partner with engineers through design, implementation, code review, and release • Build SAST, DAST, dependency scanning, and secrets detection into the development lifecycle • Perform internal red teaming and adversarial testing against APIs, proxy, and LLM-specific attack surfaces • Threat-model products and architecture changes • Create secure coding guidelines and train engineers • Harden Docker images, PyPI packages, GitHub Actions workflows, and release infrastructure • Detect dependency confusion, poisoned packages, compromised dependencies, exposed secrets, and unsafe build practices • Implement SBOMs, signed builds, provenance checks, and reproducible-build practices • Design secure-by-default configurations for cloud and self-hosted deployments • Review cloud infrastructure, network boundaries, access controls, and production deployment patterns • Strengthen employee identity, device, SaaS, and internal access controls • Build monitoring and anomaly detection for suspicious API, model, authentication, and routing activity • Lead incident response, vulnerability assessment, remediation, post-mortems, and stakeholder communication • Establish vulnerability intake, CVE triage, disclosure, and remediation processes • Maintain threat models as the product and architecture evolve
• Strong security generalist experience across application security, IT, CI/CD, cloud infrastructure, and software supply chain • Deep application-security expertise, including manually auditing production Python code and remediating vulnerabilities with engineers • Understanding of authentication, authorization, tenant isolation, SSRF, injection, deserialization, secrets management, and common web/API vulnerabilities • Experience with Semgrep, Bandit, CodeQL, Burp Suite, and other SAST/DAST tooling • Previous experience at an early-stage security startup during its 0→1 journey • Experience securing containers, GitHub Actions, build pipelines, packages, and software dependencies • Familiarity with SBOMs, Sigstore, Cosign, Snyk, Grype, Trivy, or equivalent tooling • Knowledge of OAuth2, JWT, mTLS, IAM, and high-throughput API authentication • Familiarity with prompt injection, LLM data exfiltration, tool abuse, and OWASP Top 10 for LLM Applications • Experience with incident response, CVSS scoring, vulnerability management, CVE triage, and coordinated disclosure • Experience competing in CTFs or pursuing vulnerability research, reverse engineering, bug bounties, or security projects • Genuine interest in security outside the day job • Bachelor’s or Master’s degree in Computer Science or a related field, or equivalent practical experience
• Equity • Health benefits • Dental benefits • Vision benefits • Competitive salary • Broad technical ownership • Work directly with engineers and influence security incorporation into product development
Apply NowImprove your chances of getting an interview by checking your resume score before you apply.
🕒 July 27
Product Security Engineer at Opto-Knowledge Systems Inc owning security across hardware and software systems. Leading threat modeling and compliance for product portfolio with collaboration across teams.
🇺🇸 United States – Remote
💵 $154k - $210k / year
💰 $206.5k Grant - Opto-Knowledge Systems on 2024-01
⏰ Full Time
🟠 Senior
🔴 Lead
👮♂️ Cybersecurity / Security Engineer
🕒 July 27
Senior Software Engineer developing scalable security infrastructure at Cadence Solutions. Involved in AI governance and risk controls to ensure compliance in the healthcare sector.
🇺🇸 United States – Remote
💵 $170k - $220k / year
⏰ Full Time
🟠 Senior
👮♂️ Cybersecurity / Security Engineer
🕒 July 27
Senior Security Engineer ensuring application security while embedding security in the development lifecycle at a leading AI cybersecurity startup. Collaborating closely with engineering teams on secure software practices.
🇺🇸 United States – Remote
💵 $100k - $300k / year
⏰ Full Time
🟠 Senior
👮♂️ Cybersecurity / Security Engineer
🕒 July 27
iOS Security Researcher joining a team at Dataflow Security. Involves conducting vulnerability research, reverse engineering, and exploit development on iOS.
🕒 July 27
Security Researcher specializing in server-side vulnerabilities for web applications. Conduct research and develop exploits while collaborating with experienced security researchers.