Senior Deep Learning Software Engineer, Inference, Model Optimization

🔥 6 minutes ago

🏄 California – Remote

🏄 California – Remote

💵 $184k - $356.5k / year

⏰ Full Time

🟠 Senior

🧑‍💻 Full-stack Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 1%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

NVIDIA

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Train, develop, and deploy state-of-the-art generative AI models such as LLMs and diffusion models using NVIDIA's AI software stack • Leverage and build upon the Torch 2.0 ecosystem, including TorchDynamo, torch.export, and torch.compile, to analyze and extract standardized model graph representations from arbitrary Torch models • Develop high-performance inference optimization techniques, including automated model sharding, tensor parallelism, sequence parallelism, and efficient attention kernels with KV-caching • Collaborate with teams across NVIDIA to integrate performant kernel implementations into the automated deployment solution • Analyze and profile GPU kernel-level performance to identify hardware and software optimization opportunities • Continuously innovate inference performance for NVIDIA's TRT, TRT-LLM, and TRT Model Optimizer software solutions • Architect and design a modular, scalable software platform supporting broad model coverage and optimization techniques

🎯 Requirements

• Masters, PhD, or equivalent experience in Computer Science, AI, Applied Math, or related field • 8+ years of relevant work or research experience in Deep Learning • Excellent software design skills, including debugging, performance analysis, and test design • Strong proficiency in Python, PyTorch, and related ML tools (e.g. HuggingFace) • Strong algorithms and programming fundamentals • Good written and verbal communication skills and the ability to work independently and collaboratively in a fast-paced environment • Contributions to PyTorch, JAX, or other Machine Learning Frameworks • Knowledge of GPU architecture and compilation stack, and capability of understanding and debugging end-to-end performance • Familiarity with NVIDIA's deep learning SDKs such as TensorRT • Prior experience in writing high-performance GPU kernels for machine learning workloads in frameworks such as CUDA, CUTLASS, or Triton

🏖️ Benefits

• Highly competitive salaries • Comprehensive benefits package • Equity