Staff/Principal Software Engineer – AI Platform Model Serving

🕒 October 27

🇺🇸 United States – Remote

💵 $890k - $1.7M / year

⏰ Full Time

🔴 Lead

🤖 AI Engineer

Where this job comes from

Posted on Netflix's careers page ↗Netflix's careers page, not through a job board

First seen by Remote Rocketship October 27

Still open on Netflix's site. Checked 2 hours ago.

Apply Now
Logo of Netflix

Netflix

10,000+ employees

Founded 1997

📱 Media

👥 B2C

Media • B2C

Netflix is a global streaming entertainment company and content producer whose stated mission is "to entertain the world. " It operates a consumer-facing subscription platform offering on-demand TV shows, films, and original programming, and also runs a public careers site emphasizing culture, inclusion, and hiring accommodations. The provided text highlights Netflix’s focus on recruiting talent worldwide, its work-life and culture pages, and its public-facing employer materials.

📋 Description

• Rebuild Netflix’s AI/ML model serving platform and infrastructure for real-time, asynchronous, and agentic workloads • Unify in-house inference infrastructure, third-party model hosting, and external LLM providers under a serving, routing, and experimentation layer • Enable consistent deployment, routing, and A/B testing of models regardless of hosting location • Re-engineer GPU capacity provisioning and utilization, including repurposing off-peak production capacity for internal coding and developer productivity use cases • Lead technical architecture and direction for Netflix’s GenAI and Foundation Model serving strategy • Address disaggregated serving, intelligent routing, speculative decoding, prompt caching, and multi-GPU inference • Embed AI capabilities into member-facing products at global scale • Build durable, resumable execution for long-running agentic workloads • Set and own technical direction for a growing engineering organization • Guide architectural decisions and alignment across multiple teams • Shape long-term technical roadmaps and ensure scalability, maintainability, and business alignment • Partner with product managers, operations, and executive stakeholders • Produce architecture decision records and technical proposals

🎯 Requirements

• BS/MS/PhD in Computer Science, Applied Math, Engineering, or a related field • 12+ years of relevant experience in AI/ML Infrastructure and distributed systems • Experience with high-traffic distributed services and AI/ML model inference infrastructure • Experience building scalable Foundation Model serving solutions • Practical skills reducing inference latency and costs • Familiarity with NVIDIA Triton Inference Server, vLLM, or SGLang • Experience scaling AI/ML models via Kubernetes • Experience with AWS, Azure, or GCP • Deep expertise in distributed systems and high-performance RPC • GPU/CPU inference optimization, control planes, and experimentation infrastructure • Fluency with modern LLM serving stacks • Track record architecting systems at extreme scale • Experience with high availability, security, and performance • Ability to influence architectural decisions across multiple teams • Ability to shape long-term technical roadmaps • Experience partnering with product managers, operations, and executive stakeholders • Ability to communicate complex technical concepts and produce ADRs and proposals • Open-source contributions in AI/ML, distributed systems, or infrastructure (preferred) • Hands-on AI model building and optimization techniques such as quantization, model compression, or model pruning (preferred) • Proficiency with AI coding tools (preferred) • Experience with model gateways and intelligent routing (preferred) • Exposure to multi-adapter model serving, disaggregated prefill/decode, or large-scale KV cache management (preferred) • Experience with evaluation and benchmarking tools for LLMs and AI agents (preferred) • Knowledge of GPU topology, NVIDIA CUDA programming, and machine learning compilers (preferred) • Knowledge of PyTorch, TensorFlow, JAX, Hugging Face Transformers, vLLM, SGLang, TensorRT-LLM, TGI, DeepSpeed-Inference, NVIDIA Dynamo, CUDA, NCCL, and NVIDIA Nsight

🏖️ Benefits

• Health Plans • Mental Health support • 401(k) Retirement Plan with employer match • Stock Option Program • Disability Programs • Health Savings and Flexible Spending Accounts • Family-forming benefits • Life and Serious Injury Benefits • Paid leave of absence programs • Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off • Full-time salaried employees are immediately entitled to flexible time off

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 October 27

TEKsystems

10,000+ employees

💼 Consulting

🎯 Recruiter

🏢 Enterprise

Principal Strategy Architect guiding TEKsystems enterprise clients from strategy through AI-enabled architecture and execution. Leading executive workshops, solution design, commercial growth, and consulting teams.

🕒 October 26

SecurityScorecard

501 - 1000

💼 Consulting

🏥 Healthcare

🛡️ Insurance

Distinguished AI Software Engineer transforming how SecurityScorecard, a global cybersecurity ratings company, builds software. Developing agentic workflows and customer-facing AI security features.

🇺🇸 United States – Remote

💵 $350k - $500k / year

💰 $180M Series E on 2021-03

⏰ Full Time

🔴 Lead

🤖 AI Engineer

🕒 October 26

Cobalt

201 - 500

🔐 Security

☁️ SaaS

Staff AI Engineer designing reliable, secure and cost-efficient production agents for Cobalt’s pentesting platform. Setting agent architecture, evaluation, observability and engineering standards across teams.

🕒 October 23

8am

501 - 1000

⚖️ Legal

☁️ SaaS

💳 Fintech

Staff Software Engineer building and deploying scalable AI/ML features for 8am’s SaaS platform. Developing Python, LLM, data infrastructure, and cloud deployment solutions for professional services.

🇺🇸 United States – Remote

💵 $150k - $190k / year

💰 Private equity on 2024-08

⏰ Full Time

🔴 Lead

🤖 AI Engineer

🕒 October 23

VSP Vision Care

1001 - 5000

🏥 Healthcare

📣 Marketing

🍽️ Food & Beverage

Leading VSP Vision’s enterprise AI platforms, governance, and engineering strategy. Building secure, scalable machine learning, agentic AI, and AI-enabled BI capabilities remotely in the US.

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok