Software Engineer, CUDA Deep Learning Systems

🕒 August 5

🏄 California, Texas – Remote

🏄 California – Remote 🤠 Texas – Remote

💵 $124k - $195.5k / year

⏰ Full Time

🟢 Junior

🟡 Mid-level

🧑‍💻 Full-stack Engineer

🚫👨‍🎓 No degree required

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 19%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

NVIDIA

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Explore, research, and prototype systems optimizations for advanced deep learning models across high-level frameworks and low-level CUDA • Architect and optimize distributed computing systems from single-node to cluster-scale supercomputing environments • Design, implement, and optimize custom high-performance CUDA kernels • Analyze hardware-software interactions and resolve performance bottlenecks in training and inference pipelines • Collaborate with AI researchers, hardware and software architects, kernel and compiler authors, and CUDA driver experts • Co-design systems and algorithms to improve accelerator utilization, memory bandwidth, cross-node communication efficiency, and programmability • Develop exploratory tools and runtime systems to profile and accelerate new deep learning paradigms • Write maintainable code and transition prototypes into open-source releases, framework integrations, internal tools, or commercial products

🎯 Requirements

• BS, MS, or PhD degree in Computer Science, Computer Engineering, Electrical Engineering, or related field (or equivalent experience) • 2+ years of relevant industry experience or equivalent academic experience after degree achievement • Strong proficiency in C++ and Python programming • Solid background in the fundamentals of Deep Learning with a focus on transformers • Strong understanding of distributed computing principles, multi-node scaling, and cluster-scale execution performance challenges • Proven experience in systems programming, computer architecture, and low-level systems performance optimization • Familiarity with GPU architectures and hands-on experience with CUDA programming, kernel optimization, and workload profiling • Experience profiling and optimizing generative AI models, including large language models • Research background in machine learning systems or adjacent fields • Experience profiling and optimizing vision models, generative AI architectures, or diffusion models • Track-record of initiative and willingness to deep-dive on problems across the stack • [Preferred] Deep expertise in performance internals and execution graphs of PyTorch, JAX, TensorRT, vLLM, sgLang, Nemo, or Megatron • [Preferred] Hands-on experience with NCCL, MPI, or UCX and distributed machine learning techniques • [Preferred] Knowledge of numerical methods and low-precision arithmetic such as NVFP4, MXFP4, FP8, or INT8 • [Preferred] Background in deep learning compilers and ML systems, including Triton, XLA, or torch.compile • [Preferred] Experience designing and implementing agentic AI systems

🏖️ Benefits

• Equity • Benefits