Senior Deep Learning Software Engineer – Inference

🕒 August 10

🌐 Netherlands, Germany, +1 more countries – Remote

🇳🇱 Netherlands – Remote 🇩🇪 Germany – Remote 🇵🇱 Poland – Remote

💵 zł221.3k - zł507k / year

⏰ Full Time

🟠 Senior

🧑‍💻 Full-stack Engineer

👻 Ghost score 29%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

NVIDIA

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Design, build, and optimize GPU-accelerated software powering sophisticated AI applications • Develop and maintain high-performance deep learning frameworks, including SGLang and vLLM • Improve platforms to facilitate deployment and serving of language models • Implement the latest algorithms for public release in SGLang, vLLM, and other deep learning frameworks • Identify and drive performance improvements for state-of-the-art LLM and Generative AI models across NVIDIA accelerators, from datacenter GPUs to edge SoCs • Use open-source tools and plugins, including CUTLASS, OAI Triton, NCCL, and CUDA kernels, to implement and optimize model serving pipelines • Optimize, analyze, and tune deep learning models in LLM, Multimodal, and Generative AI domains • Scale deep learning model performance across different architectures and NVIDIA accelerator types • Contribute features and code to NVIDIA inference libraries, vLLM, SGLang, FlashInfer, and LLM software solutions • Collaborate with cross-functional teams across frameworks, NVIDIA libraries, and inference optimization solutions

🎯 Requirements

• Masters or PhD or equivalent experience in relevant field (Computer Engineering, Computer Science, EECS, AI) • 5+ years of relevant software development experience • Excellent C/C++ programming and software design skills • SW Agile skills are helpful • Python experience is a plus • Prior experience with training, deploying or optimizing the inference of DL models in production is a plus • Prior background with performance modeling, profiling, debug, and code optimization or architectural knowledge of CPU and GPU is a plus • Contribute to Deep Learning Software projects, such as PyTorch, vLLM, and SGLang to drive advancements in the field • Experience with Multi-GPU Communications (NCCL, NVSHMEM) • Experience building and shipping products to enterprise customers • GPU programming experience (CUDA, OAI TRITON or CUTLASS)

🏖️ Benefits

• Highly competitive salaries • Extensive benefits package • Work environment that promotes diversity, inclusion, and flexibility

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume