Product Manager – AI Inference, Model Serving

🕒 il y a 2 mois

🤠 Texas – Distant

🤠 Texas – Remote

⏰ Temps Plein

🟠 Senior

🔴 Expert

✅ Responsable Produit

🦅 Parrain de Visa H1B

Cette entreprise a parrainé des visas H1B par le passé.

Postuler Maintenant

Trouver des Emplois à Distance Similaires

Configurer une alerte email pour les nouveaux emplois

📊 Vérifiez votre score de CV pour ce poste

Améliorez vos chances d'obtenir un entretien en vérifiant votre score de CV avant de postuler.

Télécharger le CV

Mirantis

Site WebLinkedInTous les Emplois

501 - 1000 employés

💼 Conseil

🏥 Santé

📦 Logistique

Consulting • Healthcare • Logistics

Mirantis est une entreprise spécialisée dans la gestion de conteneurs et les solutions d'infrastructure cloud. Elle propose une gamme de produits, notamment Mirantis Kubernetes Engine (MKE), Mirantis OpenStack pour Kubernetes (MOSK) et Mirantis Container Cloud (MCC), qui offrent des plateformes de gestion de Kubernetes et de conteneurs de niveau entreprise. Mirantis développe également des outils pour des chaînes d'approvisionnement logicielles sécurisées, tels que le Mirantis Container Runtime (MCR) et le Mirantis Secure Registry (MSR). En tant que défenseur des technologies open source, Mirantis soutient divers projets et fournit des ressources comme Lens Desktop, un IDE Kubernetes populaire, et un support technique pour les entreprises adoptant des technologies cloud-natives. Leurs solutions s'adressent à des secteurs tels que les services publics, les services financiers et les industries des services technologiques et SaaS au sens large.

Description

• Own product strategy, roadmap, and lifecycle for inference and model serving, including serverless inference, dedicated endpoints, autoscaling, routing, KV cache management, and the related observability • Lead deep technical discovery with NeoClouds, sovereign clouds, and enterprise platform teams, and translate findings into prioritized requirements and architecture direction • Partner with engineering on system design trade-offs across runtime integration, GPU scheduling, network, storage, and serving topology, including disaggregated serving and multi-model serving • Define positioning grounded in measurable outcomes: latency distributions, throughput per GPU, utilization, tail reliability, and cost per tokens • Drive go-to-market execution: pricing and packaging, reference architectures, sizing guides, PoC playbooks, and direct engagement with customers, analysts, and ecosystem partners

🎯 Exigences

• 7+ years in product management, technical product management, or a senior technical role owning AI/ML and inference product(s) • Strong understanding of production AI inference, including model serving, serverless execution, dedicated endpoints, autoscaling, routing, workload placement, observability, and reliability • Proven capability to reason about performance trade-offs across GPU, network, storage, orchestration, and runtime layers, and to translate low-level technical capability into business value such as TTFT, throughput per GPU, and TCO • Working knowledge of modern inference runtimes (vLLM, SGLang, TensorRT-LLM, Dynamo, Triton) and the optimization patterns that matter in production: continuous batching, KV cache management, cold starts, prefill versus decode, disaggregated serving, and multi-model serving • Credibility with engineering leaders and infrastructure operators, including comfort in production architecture reviews and technical commercial conversations with platform engineering buyers.

🏖️ Avantages

• Work with an established Silicon Valley leader in the cloud infrastructure industry. • Work with exceptionally passionate, talented and engaging colleagues, helping Fortune 500 and Global 2000 customers implement next-generation cloud technologies. • Be a part of cutting-edge, open-source innovation. • Thrive in the high-energy environment of a young company where openness, collaboration, risk-taking, and continuous growth are valued. • Professional development and training. • Attend conferences and working groups. • Customized workstation (macOS, Windows). • A competitive compensation package with strong benefits plan and stock options.