Senior Deep Learning Software Infrastructure Engineer

πŸ•’ August 6

Where this job comes from

Posted on NVIDIA's careers page β†—NVIDIA's careers page, not through a job board

First seen by Remote Rocketship August 6

Still open on NVIDIA's site. Checked 2 hours ago.

Apply Now
Logo of NVIDIA

NVIDIA

10,000+ employees

Founded 1993

πŸ₯ Healthcare

🏭 Manufacturing

πŸ€– Artificial Intelligence

Healthcare β€’ Manufacturing β€’ Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

πŸ“‹ Description

β€’ Craft, scale, and harden deep learning infrastructure libraries and frameworks for training on multi-thousand GPU clusters β€’ Improve efficiency throughout the training stack, including data loaders, distributed training, scheduling, and performance monitoring β€’ Build robust training pipelines and libraries for massive video datasets and rapid experimentation β€’ Collaborate with researchers, model engineers, and internal platform teams to enhance efficiency, minimize stalls, and improve training availability β€’ Own core infrastructure components such as orchestration libraries, distributed training frameworks, and fault-resilient training systems β€’ Partner with leadership to scale infrastructure with growing GPU capacity and dataset size while maintaining developer efficiency and stability

🎯 Requirements

β€’ BS, MS, or PhD in Computer Science, Electrical/Computer Engineering, or a related field, or equivalent experience β€’ 12+ years of professional experience building and scaling high-performance distributed systems, ideally in ML, HPC, or large-scale data infrastructure β€’ Extensive knowledge of deep learning frameworks, with PyTorch preferred β€’ Knowledge of large-scale training, including DDP/FSDP, NCCL, tensor parallelism, and pipeline parallelism β€’ Experience with performance profiling β€’ Strong systems background in datacenter networking, including RoCE and IB β€’ Experience with parallel filesystems, including Lustre β€’ Knowledge of storage systems and schedulers such as Slurm and Kubernetes β€’ Proficiency in Python and experience writing production-grade libraries, orchestration layers, and automation tools β€’ Ability to work with ML researchers, infrastructure engineers, and product leads and translate requirements into robust systems β€’ Experience scaling GPU training clusters with more than 1,000 GPUs β€’ Expertise in fault resilience and high availability, including elastic training and large-scale observability β€’ Hands-on technical leadership and ability to establish guidelines for ML systems engineering

πŸ–οΈ Benefits

β€’ Equity β€’ Benefits

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ August 6

SentinelOne

1001 - 5000

πŸ’Ό Consulting

πŸ₯ Healthcare

πŸ“¦ Logistics

Staff AI Platform Engineer owning AI Gateway infrastructure for SentinelOne’s AI-native cybersecurity platform. Scaling secure model serving, reliability, LLMOps, and developer tooling across enterprise environments.

πŸ•’ July 31

Broadcom

10,000+ employees

🏭 Manufacturing

πŸ“¦ Logistics

πŸ’Ό Consulting

Kubernetes Platform Infrastructure Architect enabling enterprise success with VMware vSphere Kubernetes Service. Collaborating with customers on designing software-defined data centers and modern applications.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $110.8k - $177.3k / year

πŸ’° Post-IPO Equity on 2017-10

⏰ Full Time

πŸ”΄ Lead

πŸ‘· Infrastructure Engineer

πŸ•’ July 28

Runpod

51 - 200

πŸ€– Artificial Intelligence

☁️ SaaS

🀝 B2B

Director of Infrastructure Engineering at Runpod, leading core cloud operations and scaling infrastructure for AI workloads.

πŸ•’ July 21

Airbnb

5001 - 10000

✈️ Travel

πŸ“¦ Logistics

πŸ›οΈ eCommerce

Staff Infrastructure Engineer powering Airbnb’s real-time data and online storage platforms. Leading distributed systems, ingestion architecture, cross-functional projects, and engineering teams.

πŸ•’ July 15

Broadcom

10,000+ employees

🏭 Manufacturing

πŸ“¦ Logistics

πŸ’Ό Consulting

Private Cloud Infra Architect working with enterprise customers to design and deploy VMware Cloud Foundation solutions. Engaging in high-level architectural validation and integration of Kubernetes networking.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $110.8k - $177.3k / year

πŸ’° Post-IPO Equity on 2017-10

⏰ Full Time

πŸ”΄ Lead

πŸ‘· Infrastructure Engineer

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok