Senior Product Manager – LLM Inference

🔥 1 minute ago

🇬🇧 United Kingdom – Remote

⏰ Full Time

🟠 Senior

✅ Product Manager

👻 Ghost score 25%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Runware

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2023

🤖 Artificial Intelligence

🔌 API

📱 Media

Artificial Intelligence • API • Media

Runware is a flexible generative AI platform that specializes in high-quality media creation for images and videos through an affordable and fast API. It is capable of advanced tasks such as image generation, video inference, upscaling, and background removal, making it an essential tool for developers seeking to enhance their projects with AI technology. Powered by a custom Sonic Inference Engine™ and renewable energy, Runware ensures quick and efficient media generation without requiring complex infrastructure or machine learning expertise.

📋 Description

• Own the LLM inference product strategy and roadmap across model availability, API capabilities, production readiness, and customer adoption • Drive customer discovery and product-market fit with developers, AI teams, and technical decision-makers • Own the model catalog and lifecycle, including model discovery, evaluation, launches, deprecations, selection, serving, and routing • Shape developer experience and API capabilities, including compatibility, SDKs, documentation, streaming, tool calling, structured outputs, caching, batch inference, OpenAI Chat Completions, and Anthropic Messages formats • Define production inference requirements for latency, time to first token, throughput, concurrency, availability, serving efficiency, dedicated capacity, rate limits, routing, fallbacks, and observability • Drive adoption and commercial growth through positioning, pricing, packaging, technical evaluations, production usage, and dedicated inference commitments • Translate enterprise needs into scalable capabilities for data residency, retention controls, service commitments, and other production requirements • Write requirements, prototype solutions, test APIs, reproduce customer issues, resolve technical constraints, and deliver high-quality releases • Track activation, production usage, retention, expansion, revenue, gross margin, and service quality to refine priorities and measure impact • Partner with Engineering, Design, Security, Sales, Marketing, Partnerships, and the Serverless & Compute Product Manager

🎯 Requirements

• Proven product ownership in a technical, developer-facing environment, including API products, developer platforms, AI infrastructure, or similarly complex offerings • Experience leading products from strategy and development through launch, adoption, and commercial growth • Strong understanding of production LLM inference, including model capabilities and serving trade-offs involving output quality, context length, token consumption, latency, throughput, reliability, and cost • Deep understanding of developer experience and API products, including API design, compatibility, migration, SDKs, documentation, and model capabilities • Strong commercial and product judgment concerning customer requirements, technical constraints, market opportunities, pricing, and unit economics • Experience working directly with technical customers, developers, and technical decision-makers • Hands-on technical aptitude with API testing, product behavior analysis, usage data, prototypes, and implementation trade-offs • Strong execution and cross-functional leadership, including navigating ambiguity, communicating decisions, aligning stakeholders, and accountability for outcomes • Strong differentiators include experience with LLM inference APIs, model-serving platforms, AI infrastructure, GPU inference, batching, quantization, KV caching, capacity planning, vLLM, SGLang, TensorRT-LLM, LLM evaluation, benchmarking, production applications, usage-based pricing, token metering, billing systems, data security, data residency, observability, service reliability, software engineering, machine learning engineering, infrastructure, or developer tooling

🏖️ Benefits

• Remote-first work arrangement with in-person meetings twice a year • Core hours for cooperative working and calls, with flexible scheduling outside core hours • Generous paid time off including vacation, sick days, and public holidays • Meaningful stock options • Paid maternity, paternity, and caregiver leave • Twice-yearly company retreats • Downtime after major release cycles to unplug and recharge

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume