Senior Technical Product Manager – Token Factory, Inference

Job not on LinkedIn

November 20

Apply Now

Receive Emails with Similar Jobs

Nebius Group

WebsiteLinkedInAll Job Openings

AI • Enterprise • SaaS

Nebius Group is building one of the world’s leading AI infrastructure companies, focusing on providing the necessary compute, storage, and tools for developers in the AI space. Based in Europe and listed on Nasdaq, Nebius has a global presence with R&D centers across Europe, North America, and Israel. The company's primary offering is an AI-centric cloud platform designed for intensive AI workloads, complemented by various other businesses involved in generative AI development, edtech, and autonomous technology.

1001 - 5000 employees

🏢 Enterprise

☁️ SaaS

📋 Description

• Own the product roadmap for Nebius Token Factory inference capabilities, focusing on high-load, production-grade ML scenarios. • Be involved in customer PoCs involving distributed ML model deployment, inference orchestration, and optimization. • Work closely with engineering and research teams to shape scalable infrastructure for real-time and batch inference. • Act as the technical voice in customer conversations, translating ML workflows into product requirements. • Drive product adoption by delivering tools and features that solve real-world inference problems at scale.

🎯 Requirements

• 3–5 years of product management experience, ideally in cloud infrastructure, ML platforms, or developer tools. • Strong technical foundation (e.g. Computer Science or Engineering degree) with ability to dive deep into model architectures and serving systems. • Familiarity with modern ML inference tools and frameworks (e.g., Triton Inference Server, vLLM, SGLang, TensorRT-LLM, Dynamo, KServe, Ray Serve). • Proven track record of delivering technically complex products that support distributed and high-throughput ML pipelines. • Strong communicator with experience working across engineering, research, and customer-facing teams.

🏖️ Benefits

• Health insurance: 100% company-paid medical, dental, and vision coverage for employees and families. • 401(k) plan: Up to 4% company match with immediate vesting. • Parental leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers. • Remote work reimbursement: Up to $85/month for mobile and internet. • Disability & life insurance: Company-paid short-term, long-term and life insurance coverage.