Senior Software Engineer – NIM Platform SDK and Framework

🕒 il y a 2 mois

🏄 California, New York, +1 états de plus – Distant

🏄 California – Remote 🗽 New York – Remote 🤠 Texas – Remote

💵 $184 000 - $356 500 / an

⏰ Temps Plein

🟠 Senior

🧑‍💻 Développeur Full-Stack

🦅 Parrain de Visa H1B

Cette entreprise a parrainé des visas H1B par le passé.

Postuler Maintenant

Trouver des Emplois à Distance Similaires

Recevoir des emails pour des emplois à distance

📊 Vérifiez votre score de CV pour ce poste

Améliorez vos chances d'obtenir un entretien en vérifiant votre score de CV avant de postuler.

Télécharger le CV

NVIDIA

Site WebLinkedInTous les Emplois

10 000+ employés

Fondée en 1993

🤖 Intelligence artificielle

🎮 Jeux vidéo

Artificial Intelligence • Gaming • Automotive

NVIDIA est une entreprise technologique de premier plan, spécialisée dans le calcul accéléré et l’intelligence artificielle (IA). NVIDIA est à l’avant‑garde des avancées en GPU (processeurs graphiques), cloud computing, centres de données et réalité virtuelle, avec un accent particulier sur les secteurs du gaming, de l’automobile, de la santé et de la robotique. Ses innovations, telles que NVIDIA Omniverse, transforment les processus numériques traditionnels en permettant des simulations haute fidélité et des tâches de rendu de pointe. Ses applications couvrent de nombreux secteurs, des véhicules autonomes avec NVIDIA DRIVE aux solutions de santé avec NVIDIA Clara, ainsi que des analyses et workflows pilotés par l’IA.

Description

• Develop and advance the inference microservice framework: OpenAI-compatible API endpoints, inference backend integrations (vLLM, SGLang, TensorRT-LLM, Dynamo), middleware, observability instrumentation, and production hardening across cloud, on-prem, and Kubernetes environments • Architect significant new features in open-source codebases, shepherding them through project acceptance and into production • Build and optimize high-performance model download and caching pipelines across multiple cloud storage backends (NGC, HuggingFace, S3, GCS) - parallel transfers, integrity verification, and seamless multi-cloud operability • Implement the model profile and manifest system that ensures NIMs are optimized for every NVIDIA GPU platform - profile selection, validation, and multi-GPU configuration • Develop and refine cloud microservice patterns - service discovery, health checking, graceful degradation, API gateway integration, and end-to-end request lifecycle management - to ensure NIMs operate reliably at scale in diverse cloud deployment environments • Be a role model for high-quality code across Python, Rust, and C/C++, and model guidelines in test-driven development, agentic AI-assisted development, code review, and cross-team collaboration • Mentor teammates and establish high engineering standards for container quality, security, and operability

🎯 Exigences

• BS or MS in Computer Science, Computer Engineering, or related field (or equivalent experience) • 8+ years of demonstrated experience developing performant microservice, cloud software and/or platform infrastructure roles • Deep technical expertise in cloud-native microservice architecture, including service mesh, API gateways, load balancing, and distributed system build patterns • Expertise in high-performance data pipelines with parallel I/O, caching strategies, and integrity verification across distributed storage systems • Solid understanding of containerized application delivery using technologies such as Docker, Kubernetes, and Helm • Understanding of application security principles, including secure coding practices, vulnerability mitigation, secrets management, and supply chain integrity for containerized environments • Strong problem-solving skills grounded in first-principles reasoning and critical analysis • Excellent programming skills in Python and Rust, with strong foundations in algorithms, development patterns, and software engineering principles

🏖️ Avantages

• Eligible for equity • Benefits offered