Product Manager – AI Inference, Model Serving

πŸ•’ May 28

Where this job comes from

Posted on Mirantis's careers page β†—Mirantis's careers page, not through a job board

First seen by Remote Rocketship May 28

Still open on Mirantis's site. Checked 4 hours ago.

Apply Now
Logo of Mirantis

Mirantis

501 - 1000 employees

πŸ’Ό Consulting

πŸ₯ Healthcare

πŸ“¦ Logistics

Consulting β€’ Healthcare β€’ Logistics

Mirantis is a company that specializes in container management and cloud infrastructure solutions. It offers a range of products, including Mirantis Kubernetes Engine (MKE), Mirantis OpenStack for Kubernetes (MOSK), and Mirantis Container Cloud (MCC), which provide enterprise-level Kubernetes and container management platforms. Mirantis also develops tools for secure software supply chains, such as the Mirantis Container Runtime (MCR) and Mirantis Secure Registry (MSR). As an advocate for open source technologies, Mirantis supports various projects and provides resources like Lens Desktop, a popular Kubernetes IDE, and technical support for enterprises adopting cloud-native technologies. Their solutions cater to sectors such as public services, financial services, and broader SaaS and technology services industries.

πŸ“‹ Description

β€’ Own product strategy, roadmap, and lifecycle for inference and model serving, including serverless inference, dedicated endpoints, autoscaling, routing, KV cache management, and the related observability β€’ Lead deep technical discovery with NeoClouds, sovereign clouds, and enterprise platform teams, and translate findings into prioritized requirements and architecture direction β€’ Partner with engineering on system design trade-offs across runtime integration, GPU scheduling, network, storage, and serving topology, including disaggregated serving and multi-model serving β€’ Define positioning grounded in measurable outcomes: latency distributions, throughput per GPU, utilization, tail reliability, and cost per tokens β€’ Drive go-to-market execution: pricing and packaging, reference architectures, sizing guides, PoC playbooks, and direct engagement with customers, analysts, and ecosystem partners

🎯 Requirements

β€’ 7+ years in product management, technical product management, or a senior technical role owning AI/ML and inference product(s) β€’ Strong understanding of production AI inference, including model serving, serverless execution, dedicated endpoints, autoscaling, routing, workload placement, observability, and reliability β€’ Proven capability to reason about performance trade-offs across GPU, network, storage, orchestration, and runtime layers, and to translate low-level technical capability into business value such as TTFT, throughput per GPU, and TCO β€’ Working knowledge of modern inference runtimes (vLLM, SGLang, TensorRT-LLM, Dynamo, Triton) and the optimization patterns that matter in production: continuous batching, KV cache management, cold starts, prefill versus decode, disaggregated serving, and multi-model serving β€’ Credibility with engineering leaders and infrastructure operators, including comfort in production architecture reviews and technical commercial conversations with platform engineering buyers.

πŸ–οΈ Benefits

β€’ Work with an established Silicon Valley leader in the cloud infrastructure industry. β€’ Work with exceptionally passionate, talented and engaging colleagues, helping Fortune 500 and Global 2000 customers implement next-generation cloud technologies. β€’ Be a part of cutting-edge, open-source innovation. β€’ Thrive in the high-energy environment of a young company where openness, collaboration, risk-taking, and continuous growth are valued. β€’ Professional development and training. β€’ Attend conferences and working groups. β€’ Customized workstation (macOS, Windows). β€’ A competitive compensation package with strong benefits plan and stock options.

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ May 22

Allstate

10,000+ employees

πŸ’Ό Consulting

πŸ“¦ Logistics

πŸ›‘οΈ Insurance

Digital Product Manager shaping digital products and platform capabilities at Allstate, an insurer protecting families and belongings. Defining strategy, roadmaps, backlogs, and product performance across multiple levels.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $110k - $181k / year

πŸ’° Post-IPO Equity on 2014-01

⏰ Full Time

🟑 Mid-level

🟠 Senior

βœ… Product Manager

πŸ•’ May 21

MetaMask

51 - 200

β‚Ώ Crypto

🌐 Web 3

πŸ’³ Fintech

Senior Product Manager building MetaMask’s reusable KYC identity platform for Web3 users. Leading verification infrastructure, compliant onboarding, and cross-product identity reuse.

πŸ•’ May 21

Palo Alto Networks

10,000+ employees

πŸ”’ Cybersecurity

🏒 Enterprise

Senior Product Manager leading Storage and Cost Optimization at Chronosphere. Bridging technical needs between customers and engineering while driving product strategy and execution.

πŸ•’ May 19

Bitwave

11 - 50

πŸ’Έ Finance

β‚Ώ Crypto

πŸ“‹ Compliance

Product Manager responsible for managing payments solutions in enterprise software environment. Overseeing product lifecycle and coordinating with engineering and design teams to meet client needs.

πŸ•’ May 19

Wisdom

1 - 10

πŸ₯ Healthcare

πŸ’Ό Consulting

βš•οΈ Healthcare Insurance

Principal Product Manager driving AI product strategy for dental practices' billing processes. Collaborating with teams to improve workflows while building agentic AI solutions.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok