Senior Deep Learning Software Engineer, Inference

🔥 0 minutes ago

🌐 Poland, Netherlands, +1 more countries – Remote

🇵🇱 Poland – Remote 🇳🇱 Netherlands – Remote 🇬🇧 United Kingdom – Remote

💵 zł221.3k - zł507k / year

⏰ Full Time

🟠 Senior

🧑‍💻 Full-stack Engineer

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

NVIDIA

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Design, build, and optimize GPU-accelerated software for AI applications • Develop and maintain high-performance deep learning frameworks, including SGLang and vLLM • Improve platforms to facilitate deployment and serving of language models • Implement the latest algorithms for public release in SGLang, vLLM, and other deep learning frameworks • Identify and drive performance improvements for state-of-the-art LLM and Generative AI models across NVIDIA accelerators • Use open-source tools and plugins including CUTLASS, OAI Triton, NCCL, and CUDA kernels to implement and optimize model-serving pipelines • Optimize, analyze, and tune deep learning models across LLM, multimodal, and Generative AI domains • Scale deep learning model performance across architectures and NVIDIA accelerator types • Contribute features and code to NVIDIA inference libraries, vLLM, SGLang, FlashInfer, and LLM software solutions • Collaborate with teams across frameworks and NVIDIA libraries on inference optimization solutions

🎯 Requirements

• Master's or PhD or equivalent experience in a relevant field, such as Computer Engineering, Computer Science, EECS, or AI • 5+ years of relevant software development experience • Excellent C/C++ programming and software design skills • SW Agile skills are helpful • Python experience is a plus • Prior experience training, deploying, or optimizing deep learning model inference in production is a plus • Background in performance modeling, profiling, debugging, code optimization, or CPU/GPU architectural knowledge is a plus • Experience contributing to deep learning software projects such as PyTorch, vLLM, and SGLang is a differentiator • Experience with multi-GPU communications, including NCCL and NVSHMEM, is a differentiator • Experience building and shipping products to enterprise customers is a differentiator • GPU programming experience with CUDA, OAI Triton, or CUTLASS is a differentiator

🏖️ Benefits

• Highly competitive salaries • Extensive benefits package • Work environment that promotes diversity, inclusion, and flexibility