Staff Software Engineer, AI Gateway

πŸ•’ October 15

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $170.3k - $275.6k / year

⏰ Full Time

🟠 Senior

πŸ”΄ Lead

πŸ€– AI Engineer

Where this job comes from

Posted on Docker, Inc's careers page β†—Docker, Inc's careers page, not through a job board

First seen by Remote Rocketship October 15

Still open on Docker, Inc's site. Checked 2 hours ago.

Apply Now
Logo of Docker, Inc

Docker, Inc

51 - 200 employees

πŸ’Ό Consulting

☁️ SaaS

πŸ’° $105M Series C on 2022-03

Consulting β€’ SaaS

Docker, Inc is a company that simplifies the lives of developers by tackling the complexity of app development. They offer tools that allow developers to bring their ideas to life through containerization and orchestration, making the development process easier and more efficient. Docker's products, including Docker Desktop and Docker Hub, are widely adopted by millions of developers worldwide, enhancing workflows and providing an integrated development pipeline.

πŸ“‹ Description

β€’ Set technical direction for core AI Gateway systems, including the model router, MCP gateway, and control plane β€’ Ensure architectural decisions support 10x usage growth β€’ Identify infrastructure, process, and tooling gaps and drive fixes through production β€’ Define, deliver, and implement the Gateway's technical strategy with engineering leadership β€’ Solve complex problems involving dynamic model selection, auto-failover, cost-based routing, and end-to-end policy enforcement β€’ Serve as the expert for secure credential storage, session summarization, caching, and rate limiting β€’ Build infrastructure for evaluating, replaying, and backtesting agent and LLM behavior β€’ Mentor senior and mid-level engineers through code, design review, and example β€’ Partner with product, design, and leadership on control plane UI direction and product strategy β€’ Define a unified abstraction layer across model and tool providers including OpenAI, Anthropic, Google, and AWS Bedrock β€’ Architect secure, scalable identity and credential vaulting for enterprise-scale access β€’ Build real-time and historical analytics infrastructure for AI agent behavior β€’ Ensure policy enforcement and logging work end-to-end from prompt to tool to response β€’ Set the standard for developer experience through intuitive APIs and first-class observability

🎯 Requirements

β€’ 8+ years of backend engineering experience β€’ Track record of owning production-grade systems at significant scale β€’ Deep specialization in distributed systems, cloud-native infrastructure, and API design β€’ Experience building secure, high-throughput services such as gateways, proxies, load balancers, and policy engines β€’ Fluency in Go and/or Rust β€’ Track record of identifying systemic gaps and driving fixes across team boundaries β€’ Strong product mindset and experience shaping technical direction β€’ Ability to operate autonomously with wide latitude β€’ Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience β€’ Prior experience with OpenAI, Anthropic, or similar LLM APIs is a bonus β€’ Familiarity with RAG architectures, vector databases, or agent frameworks is a bonus β€’ Experience with policy engines, observability frameworks, or API gateways is a bonus β€’ Understanding of OAuth 2.1, secret management, and cloud IAM systems is a bonus β€’ Experience with Kubernetes, Docker, and microservices architecture is a bonus β€’ Sponsorship considered case-by-case based on business needs

πŸ–οΈ Benefits

β€’ Equity for all full-time employees β€’ Remote-first work from home β€’ Flexible schedule β€’ Generous PTO β€’ Designated quarterly Whaleness Days β€’ Designated end-of-year Whaleness break β€’ Home office support β€’ Technology stipend equivalent to US$100 net per month β€’ Annual learning and development stipend for conferences, courses, certifications, and continued learning β€’ 16 weeks of paid parental leave after six months of employment β€’ Medical benefits β€’ Retirement benefits β€’ Paid holidays β€’ Docker swag

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ October 15

NeuraFlash

201 - 500

πŸ’Ό Consulting

🏭 Manufacturing

πŸ“£ Marketing

Forward Deployed Engineer building rapid Agentforce AI prototypes and client demonstrations. Delivering Salesforce and generative AI solutions for NeuraFlash, an Accenture AI innovation partner.

πŸ•’ October 15

North

1001 - 5000

πŸ’Ό Consulting

πŸ₯ Healthcare

πŸ“¦ Logistics

Director leading applied AI engineering for North’s payment processing and merchant services platform. Building production AI systems and a governed engineering team for regulated financial services.

πŸ•’ October 15

Life360

201 - 500

πŸ‘₯ B2C

πŸ“‘ Telecommunications

Director leading AI platforms for Life360’s family safety app, tracking devices, and GPS products. Building agent infrastructure and production AI capabilities for member-scale features.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $216.5k - $318.5k / year

πŸ’° Post-IPO Equity on 2022-11

⏰ Full Time

πŸ”΄ Lead

πŸ€– AI Engineer

πŸ•’ October 15

RealPage, Inc.

5001 - 10000

πŸ’Ό Consulting

πŸ“¦ Logistics

πŸ“£ Marketing

Senior Agentic AI Platform Engineer building reusable orchestration, runtime, and reliability infrastructure. Enabling RealPage product teams to develop, release, evaluate, and operate production AI agents.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $159.1k - $270.9k / year

πŸ’° $18.6M Post-IPO Equity - RealPage on 2022-01

⏰ Full Time

🟠 Senior

πŸ€– AI Engineer

πŸ•’ October 15

Basis Technologies

501 - 1000

πŸ’Ό Consulting

πŸ“¦ Logistics

πŸ“£ Marketing

Staff AI Engineer leading Compass, Basis’s LLM-powered agent platform for digital media operations. Architecting agent systems, MCP/A2A integrations, evaluation, and AI-assisted engineering practices.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok