Senior Production Engineer – DGX Cloud

🕒 October 31

💵 $184k - $356.5k / year

⏰ Full Time

🟠 Senior

🏭 Production Engineer

Where this job comes from

Posted on NVIDIA's careers page ↗NVIDIA's careers page, not through a job board

First seen by Remote Rocketship October 31

Still open on NVIDIA's site. Checked 5 hours ago.

Apply Now
Logo of NVIDIA

NVIDIA

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Build and operate production software, automation, and tooling for control plane services, model deployments, and inference and agentic workloads across DGX Cloud environments • Improve the reliability of inference and agentic platforms and services, including NVIDIA Cloud Functions, SGLang- and vLLM-based endpoints, and inference services built with NVIDIA Dynamo • Improve endpoint availability, inference routing, capacity management, and service health • Use infrastructure as code and GitOps to deploy, configure, validate, upgrade, and recover services consistently across environments • Build workflows for service enablement, model releases, handoff, deprecation, and ongoing operations • Replace repeatable manual work with reliable automation • Define and instrument SLIs and SLOs for inference and control plane services • Use error budgets to guide reliability improvements and make production health visible to partner teams • Participate in on-call and incident response • Troubleshoot failures across routing, model runtimes, software, and infrastructure • Turn recurring issues into automation and durable fixes • Collaborate with model, platform, storage, networking, security, and GPU infrastructure teams to design and operate services safely at scale

🎯 Requirements

• 8+ years of experience building or operating production services and large-scale distributed systems, including hands-on automation • Strong programming skills in Python, Go, or a comparable language • Experience developing tools for production operations • Experience with infrastructure as code, configuration management, or GitOps • Experience building automation for repeatable service deployments and changes • Strong knowledge of Linux, Kubernetes, containers, cloud infrastructure, distributed systems, and networking fundamentals • Ability to diagnose failures in production • Understanding of SRE principles, including SLIs, SLOs, error budgets, incident response, and reducing operational toil • Experience instrumenting services and using metrics, logs, and traces to understand system behavior and improve reliability • Clear technical communication and ability to work across engineering teams • BS/MS in Computer Science or equivalent experience • Familiarity with vLLM, SGLang, PyTorch, TensorRT-LLM, NVIDIA Dynamo, CUDA, or NCCL, and GPU performance analysis • Experience building Kubernetes operators, controllers, workload orchestration services, fleet management systems, or self-healing automation • Experience with Terraform, Argo CD, CI/CD, policy validation, or safe deployment and rollback systems • Experience developing with AI tools and agents • Background with production AI inference or agentic workloads, including debugging issues across models, runtimes, Kubernetes, and hardware

🏖️ Benefits

• Equity • Benefits

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 August 18

EXL

10,000+ employees

🏥 Healthcare

🛡️ Insurance

📦 Logistics

Software Production Engineer designing, developing, and supporting secure enterprise applications for EXL’s healthcare analytics business. Leading scalable solutions, production support, data analysis, and technical teams.

🇺🇸 United States – Remote

💵 $60.1k - $98.7k / year

💰 $2M Venture Round on 2015-01

⏰ Full Time

🟡 Mid-level

🟠 Senior

🏭 Production Engineer

🕒 November 26, 2025

DoubleZero Foundation

1 - 10

💼 Consulting

📦 Logistics

₿ Crypto

SRE role at DoubleZero focused on automation-first reliability systems in Go, ensuring infrastructure's production readiness and performance.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok