Senior Software Engineer, CUDA Deep Learning Systems

🕒 August 5

🏄 California, Texas – Remote

🏄 California – Remote 🤠 Texas – Remote

💵 $184k - $356.5k / year

⏰ Full Time

🟠 Senior

🧑‍💻 Full-stack Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

NVIDIA

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Explore, research, and prototype systems optimizations for advanced deep learning models at the intersection of high-level deep learning frameworks and low-level CUDA through modeling, simulation, and silicon prototyping • Architect and optimize distributed computing systems from single-node to cluster-scale supercomputing environments • Design, implement, and optimize custom high-performance CUDA kernels for emerging neural network architectures and workloads • Analyze hardware-software interactions to identify and resolve performance bottlenecks in training and inference pipelines • Collaborate with AI researchers, hardware and software architects, kernel and compiler authors, and CUDA driver experts to co-design systems and algorithms • Develop exploratory tools and runtime systems to profile and accelerate new deep learning paradigms • Write clean, effective, and maintainable code and transition prototypes into open-source releases, framework integrations, internal tools, or commercial products

🎯 Requirements

• BS, MS, or PhD degree in Computer Science, Computer Engineering, Electrical Engineering, or related field, or equivalent experience • 8+ years of relevant industry experience or equivalent academic experience after degree achievement • Strong proficiency in C++ and Python programming • Solid background in deep learning fundamentals, with a focus on transformers • Strong understanding of distributed computing, multi-node scaling, and cluster-scale performance challenges • Proven experience in systems programming, computer architecture, and low-level systems performance optimization • Familiarity with GPU accelerator architectures • Hands-on experience with CUDA programming, kernel optimization, and workload profiling • Experience profiling and optimizing generative AI models, including large language models • Research background in machine learning systems or adjacent fields • Experience profiling and optimizing vision models, generative AI architectures, or diffusion models • Track record of initiative and willingness to deep-dive on problems across the stack • Preferred: expertise in performance internals and execution graphs of PyTorch, JAX, TensorRT, vLLM, sgLang, Nemo, or Megatron • Preferred: experience with NCCL, MPI, UCX, and distributed machine learning techniques such as pipeline, tensor, or expert parallelism • Preferred: knowledge of numerical methods and low-precision arithmetic such as NVFP4, MXFP4, FP8, or INT8 • Preferred: background in deep learning compilers and ML systems, including Triton, XLA, or torch.compile • Preferred: experience designing agentic AI systems for complex systems and infrastructure problems

🏖️ Benefits

• Equity • Benefits • Equal opportunity employer • Inclusive work environment