Deep Learning Software Engineer, TensorRT Performance

🔥 15 hours ago

🏄 California – Remote

🏄 California – Remote

💵 $124k - $195.5k / year

⏰ Full Time

🟢 Junior

🟡 Mid-level

🧑‍💻 Full-stack Engineer

🚫👨‍🎓 No degree required

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 1%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

NVIDIA

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Establish performance benchmarking methodologies and analysis workflows for NVIDIA's inference ecosystem • Identify performance issues and optimization opportunities across TensorRT, TensorRT-EdgeLLM, and Torch-TensorRT • Contribute features and code to NVIDIA and open-source inference frameworks • Develop optimized model pipelines involving quantization, scheduling, memory management, and distributed inference • Collaborate with teams across generative AI, automotive, robotics, image understanding, and speech understanding • Scale deep learning model performance across architectures and NVIDIA accelerators

🎯 Requirements

• Bachelor's, Master's, PhD, or equivalent experience in relevant fields (Computer Science, Computer Engineering, EECS, AI) • 2 years of relevant software development experience • Strong C++ programming skills • Strong Python programming skills • Strong software engineering skills • Experience with DL frameworks (e.g. PyTorch, JAX, TensorFlow, ONNX) and inference libraries (e.g. TensorRT, TensorRT-LLM, vLLM, SGLang, FlashInfer) • Experience with performance analysis and performance optimization • Strong foundation and architectural knowledge of GPUs (standout) • Deep understanding of modern deep learning models and workloads (standout) • Proficiency in a deep learning programming domain specific language such as CUDA, TileIR, CuTeDSL, cutlass, or Triton (standout) • Prior contributions to major LLM inference frameworks or experience with graph compilers in deep learning inference (standout) • Prior experience optimizing performance for low-latency, resource-constrained systems or embedded AI pipelines (standout)

🏖️ Benefits

• Equity • Benefits