Senior Deep Learning Software Engineer, Inference

🕒 May 6

🏄 California – Remote

🏄 California – Remote

💵 $184k - $356.5k / year

⏰ Full Time

🟠 Senior

🧑‍💻 Full-stack Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 46%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

NVIDIA

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Optimize, analyze, and tune deep learning models across LLM, multimodal, and generative AI domains • Scale deep learning model performance across different architectures and NVIDIA accelerator types • Contribute features and code to NVIDIA inference libraries, vLLM, SGLang, FlashInfer, and LLM software solutions • Collaborate with teams across frameworks, NVIDIA libraries, and inference optimization solutions • Implement the latest algorithms for public release in SGLang, vLLM, and other deep learning frameworks • Identify and drive performance improvements for state-of-the-art LLM and generative AI models across NVIDIA accelerators • Implement and optimize model-serving pipelines using open-source tools and plugins including CUTLASS, OAI Triton, NCCL, and CUDA kernels

🎯 Requirements

• Masters or PhD or equivalent experience in a relevant field (Computer Engineering, Computer Science, EECS, AI) • 6+ years of relevant software development experience • Excellent C/C++ programming and software design skills • Software Agile skills are helpful • Python experience is a plus • Prior experience with training, deploying or optimizing the inference of deep learning models in production is a plus • Prior background with performance modeling, profiling, debugging, code optimization, or CPU/GPU architectural knowledge is a plus • Experience with deep learning software projects such as PyTorch, vLLM, and SGLang is a plus • Experience with multi-GPU communications (NCCL, NVSHMEM) is a plus • Experience building and shipping products to enterprise customers is a plus • GPU programming experience with CUDA, OAI Triton, or CUTLASS is a plus

🏖️ Benefits

• Equity • Benefits