Senior Deep Learning Software Engineer, Inference – Model Optimization

🕒 il y a 2 jours

🏄 California – Distant

infoinfo

💵 $184 000 - $356 500 / an

⏰ Temps Plein

🟠 Senior

🧑‍💻 Développeur Full-Stack

🗣️🇺🇸🇬🇧 Anglais requis

D'où vient cette offre

Publiée sur la page carrières de NVIDIA, pas via un site d'emploi

Repérée par Remote Rocketship il y a 2 jours

Toujours ouverte sur le site de NVIDIA. Vérifiée il y a 1 heure.

Logo of NVIDIA

NVIDIA

10 000+ employés

Fondée en 1993

🏥 Santé

🏭 Fabrication

🤖 Intelligence artificielle

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA est une entreprise technologique de premier plan, spécialisée dans le calcul accéléré et l’intelligence artificielle (IA). NVIDIA est à l’avant‑garde des avancées en GPU (processeurs graphiques), cloud computing, centres de données et réalité virtuelle, avec un accent particulier sur les secteurs du gaming, de l’automobile, de la santé et de la robotique. Ses innovations, telles que NVIDIA Omniverse, transforment les processus numériques traditionnels en permettant des simulations haute fidélité et des tâches de rendu de pointe. Ses applications couvrent de nombreux secteurs, des véhicules autonomes avec NVIDIA DRIVE aux solutions de santé avec NVIDIA Clara, ainsi que des analyses et workflows pilotés par l’IA.

Description

• Train, develop, and deploy state-of-the generative AI models like LLMs and diffusion models using NVIDIA's AI software stack • Leverage and build upon the torch 2.0 ecosystem, including TorchDynamo, torch.export, and torch.compile, to analyze and extract standardized model graph representations from arbitrary torch models • Develop high-performance inference optimization techniques, including automated model sharding, tensor parallelism, sequence parallelism, and efficient attention kernels with KV-caching • Collaborate with teams across NVIDIA to use performant kernel implementations within the automated deployment solution • Analyze and profile GPU kernel-level performance to identify hardware and software optimization opportunities • Continuously innovate on inference performance for NVIDIA's inference software solutions, including TRT, TRT-LLM, and TRT Model Optimizer • Architect and design a modular, scalable software platform supporting broad model coverage and optimization techniques

🎯 Exigences

• Masters, PhD, or equivalent experience in Computer Science, AI, Applied Math, or related field • 8+ years of relevant work or research experience in Deep Learning • Excellent software design skills, including debugging, performance analysis, and test design • Strong proficiency in Python, PyTorch, and related ML tools (e.g. HuggingFace) • Strong algorithms and programming fundamentals • Good written and verbal communication skills and the ability to work independently and collaboratively in a fast-paced environment • Contributions to PyTorch, JAX, or other Machine Learning Frameworks • Knowledge of GPU architecture and compilation stack, and capability of understanding and debugging end-to-end performance • Familiarity with NVIDIA's deep learning SDKs such as TensorRT • Prior experience in writing high-performance GPU kernels for machine learning workloads in frameworks such as CUDA, CUTLASS, or Triton

🏖️ Avantages

• Highly competitive salaries • Comprehensive benefits package • Equity

Postuler Maintenant

📊 Vérifiez votre score de CV pour ce poste

Améliorez vos chances d'obtenir un entretien en vérifiant votre score de CV avant de postuler.

Emplois Similaires

🕒 il y a 2 jours

DigitalOcean

1001 - 5000

☁️ SaaS

Senior engineer architecting DigitalOcean’s managed Postgres and MySQL database platform. Improving distributed systems reliability, scalability, failover, and AI-ready workloads.

🗣️🇺🇸🇬🇧 Anglais requis

🕒 il y a 2 jours

DigitalOcean

1001 - 5000

☁️ SaaS

Senior Software Engineer building DigitalOcean’s managed Postgres and MySQL infrastructure. Improving distributed systems reliability, scalability, failover, and AI-adjacent cloud workloads.

🗣️🇺🇸🇬🇧 Anglais requis

🕒 il y a 2 jours

DigitalOcean

1001 - 5000

☁️ SaaS

Senior engineer architecting DigitalOcean’s managed Postgres and MySQL database platform. Improving distributed-system reliability, scalability, recovery, and AI workload support.

🗣️🇺🇸🇬🇧 Anglais requis

🕒 il y a 2 jours

DigitalOcean

1001 - 5000

☁️ SaaS

Senior Software Engineer building scalable managed database infrastructure at DigitalOcean, which simplifies cloud and AI for developers. Improving reliability, recovery, and performance for production data workloads.

🗣️🇺🇸🇬🇧 Anglais requis

🕒 il y a 2 jours

Speechify

51 - 200

🏥 Santé

🏨 Hôtellerie

📚 Éducation

Tech Lead shaping Speechify’s Android text-to-speech app used by over 50 million people. Owning major features, reliability, releases, and Android engineering direction.

🗣️🇺🇸🇬🇧 Anglais requis

Android

Dagger

iOS

JUnit

Kotlin

Node.js

Open Source

Développé par Lior Neu-ner. J'aimerais beaucoup recevoir vos retours — contactez-moi en DM ou par e-mail support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok