Senior Deep Learning Software Infrastructure Engineer

🕒 August 6

🇺🇸 United States – Remote

💵 $224k - $431.3k / year

⏰ Full Time

🔴 Lead

👷 Infrastructure Engineer

Where this job comes from

Posted on NVIDIA's careers page ↗NVIDIA's careers page, not through a job board

First seen by Remote Rocketship August 6

Still open on NVIDIA's site. Checked 1 hour ago.

Apply Now
Logo of NVIDIA

NVIDIA

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Craft, scale, and harden deep learning infrastructure libraries and frameworks for training on multi-thousand GPU clusters • Improve efficiency throughout the training stack, including data loaders, distributed training, scheduling, and performance monitoring • Build robust training pipelines and libraries for massive video datasets and rapid experimentation • Collaborate with researchers, model engineers, and internal platform teams to enhance efficiency, minimize stalls, and improve training availability • Own core infrastructure components such as orchestration libraries, distributed training frameworks, and fault-resilient training systems • Partner with leadership to scale infrastructure with growing GPU capacity and dataset size while maintaining developer efficiency and stability

🎯 Requirements

• BS, MS, or PhD in Computer Science, Electrical/Computer Engineering, or a related field, or equivalent experience • 12+ years of professional experience building and scaling high-performance distributed systems, ideally in ML, HPC, or large-scale data infrastructure • Extensive knowledge of deep learning frameworks, with PyTorch preferred • Knowledge of large-scale training, including DDP/FSDP, NCCL, tensor parallelism, and pipeline parallelism • Experience with performance profiling • Strong systems background in datacenter networking, including RoCE and IB • Experience with parallel filesystems, including Lustre • Knowledge of storage systems and schedulers such as Slurm and Kubernetes • Proficiency in Python and experience writing production-grade libraries, orchestration layers, and automation tools • Ability to work with ML researchers, infrastructure engineers, and product leads and translate requirements into robust systems • Experience scaling GPU training clusters with more than 1,000 GPUs • Expertise in fault resilience and high availability, including elastic training and large-scale observability • Hands-on technical leadership and ability to establish guidelines for ML systems engineering

🏖️ Benefits

• Equity • Benefits

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 August 6

SentinelOne

1001 - 5000

💼 Consulting

🏥 Healthcare

📦 Logistics

Staff AI Platform Engineer owning AI Gateway infrastructure for SentinelOne’s AI-native cybersecurity platform. Scaling secure model serving, reliability, LLMOps, and developer tooling across enterprise environments.

🇺🇸 United States – Remote

💵 $156k - $215k / year

⏰ Full Time

🟠 Senior

🔴 Lead

👷 Infrastructure Engineer

🕒 July 31

Broadcom

10,000+ employees

🏭 Manufacturing

📦 Logistics

💼 Consulting

Kubernetes Platform Infrastructure Architect enabling enterprise success with VMware vSphere Kubernetes Service. Collaborating with customers on designing software-defined data centers and modern applications.

🇺🇸 United States – Remote

💵 $110.8k - $177.3k / year

💰 Post-IPO Equity on 2017-10

⏰ Full Time

🔴 Lead

👷 Infrastructure Engineer

🕒 July 28

Runpod

51 - 200

🤖 Artificial Intelligence

☁️ SaaS

🤝 B2B

Director of Infrastructure Engineering at Runpod, leading core cloud operations and scaling infrastructure for AI workloads.

🇺🇸 United States – Remote

💵 $225k - $325k / year

💰 $20M Seed on 2024-06

⏰ Full Time

🟠 Senior

🔴 Lead

👷 Infrastructure Engineer

🕒 July 21

Airbnb

5001 - 10000

✈️ Travel

📦 Logistics

🛍️ eCommerce

Staff Infrastructure Engineer powering Airbnb’s real-time data and online storage platforms. Leading distributed systems, ingestion architecture, cross-functional projects, and engineering teams.

🇺🇸 United States – Remote

💵 $204k - $255k / year

💰 Post-IPO Equity on 2020-12

⏰ Full Time

🟠 Senior

🔴 Lead

👷 Infrastructure Engineer

🕒 July 15

Broadcom

10,000+ employees

🏭 Manufacturing

📦 Logistics

💼 Consulting

Private Cloud Infra Architect working with enterprise customers to design and deploy VMware Cloud Foundation solutions. Engaging in high-level architectural validation and integration of Kubernetes networking.

🇺🇸 United States – Remote

💵 $110.8k - $177.3k / year

💰 Post-IPO Equity on 2017-10

⏰ Full Time

🔴 Lead

👷 Infrastructure Engineer

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok