Deep Learning Software Engineer, Inference

🔥 6 minutes ago

🏄 California, New York, +3 more states – Remote

🏄 California – Remote 🗽 New York – Remote 🍂 Massachusetts – Remote 🤠 Texas – Remote ☕ Washington – Remote

💵 $124k - $195.5k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 Machine Learning Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

NVIDIA

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1993

🤖 Artificial Intelligence

🎮 Gaming

Artificial Intelligence • Gaming • Automotive

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Performance optimization, analysis, and tuning of DL models in various domains like LLM, Multimodal and Generative AI. • Scale performance of DL models across different architectures and types of NVIDIA accelerators. • Contribute features and code to NVIDIA’s inference libraries, vLLM and SGLang, FlashInfer and LLM software solutions. • Work with cross-collaborative teams across frameworks, NVIDIA libraries and inference optimization innovative solutions.

🎯 Requirements

• Pursuing or recently completed a MS or PhD Computer Engineering, Computer Science, EECS, AI or related field or equivalent experience. • Software development experience. • Excellent C/C++ programming and software design skills. • SW Agile skills are helpful and Python experience is a plus. • Prior experience with training, deploying or optimizing the inference of DL models in production is a plus. • Prior background with performance modeling, profiling, debug, and code optimization or architectural knowledge of CPU and GPU is a plus. • GPU programming experience (CUDA, OAI TRITON or CUTLASS) is a plus.

🏖️ Benefits

• equity • benefits