Principal Deep Learning Communication Architect

πŸ•’ April 14

Where this job comes from

Posted on NVIDIA's careers page β†—NVIDIA's careers page, not through a job board

First seen by Remote Rocketship April 14

Still open on NVIDIA's site. Checked 3 hours ago.

Apply Now
Logo of NVIDIA

NVIDIA

10,000+ employees

Founded 1993

πŸ₯ Healthcare

🏭 Manufacturing

πŸ€– Artificial Intelligence

Healthcare β€’ Manufacturing β€’ Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

πŸ“‹ Description

β€’ Define the long-term technical roadmap for communication libraries across NVIDIA’s next-generation platforms β€’ Lead the development of next-generation communication primitives and collective algorithms β€’ Partner with application developers to architect and implement specialized communication primitives β€’ Collaborate with silicon architects and software engineers to influence hardware specifications for next-generation networking β€’ Develop high-fidelity analytical models and simulators to predict system behavior under emerging workloads

🎯 Requirements

β€’ Ph.D. or M.S. in Computer Science, Electrical Engineering, or a related field (or equivalent experience) β€’ 12+ years of industry experience in high-performance computing (HPC) or distributed deep learning β€’ Deep understanding of 3D parallelism (Data, Tensor, Pipeline) and advanced strategies including Context Parallelism, Expert Parallelism, and Zero Redundancy Optimizer (ZeRO) variants β€’ Deep technical proficiency with NCCL, UCX, UCC, NVSHMEM, or MPI β€’ Experience with RDMA, RoCE, and low-level InfiniBand verbs β€’ Advanced knowledge of high-throughput inference engines and schedulers, specifically TensorRT-LLM, vLLM, SGLang, and NVIDIA Dynamo β€’ Expert knowledge of the NVIDIA GPU memory hierarchy (HBM3e/HBM4, L2 cache)

πŸ–οΈ Benefits

β€’ equity β€’ benefits

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ March 25

Tiger Analytics

1001 - 5000

πŸ₯ Healthcare

πŸ“¦ Logistics

πŸ“£ Marketing

Application Architect leading modernization of applications with AI and analytics at Tiger Analytics. Focusing on enterprise architecture and cloud-native solutions for clients.

πŸ•’ March 12

AHU Technologies Recruitment

51 - 200

πŸ’Ό Consulting

πŸ₯ Healthcare

πŸ“£ Marketing

Oversight Architect supporting operations and maintenance activities of the DC Access System. Working with vendor teams and government agencies to capture and deliver specific requirements.

πŸ•’ March 11

EVERSANA

5001 - 10000

πŸ’Ό Consulting

πŸ₯ Healthcare

βš•οΈ Healthcare Insurance

WMS Workflow Architect leading the design of Datex WMS platform for pharmaceutical operations. Overseeing work for onshore and offshore teams in compliance with industry standards.

πŸ•’ February 17

Ensono

1001 - 5000

πŸ’Ό Consulting

Expert Solution Delivery Architect involved in mainframe software conversion projects. Leading large scale technical meetings and managing project status reporting to ensure project alignment.

πŸ•’ February 5

Sentara Health

10,000+ employees

πŸ₯ Healthcare

βš•οΈ Healthcare Insurance

ServiceNow Principal Domain Architect leading and supporting enterprise architecture activities at Sentara Health. Focus on domain and infrastructure solutions in a fully remote role.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok