Principal Machine Learning Engineer, Inference

Job not on LinkedIn

🔥 34 minutes ago

🇬🇧 United Kingdom – Remote

💵 £140k - £200k / year

⏰ Full Time

🔴 Lead

🤖 Machine Learning Engineer

👻 Ghost score 1%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Inworld AI

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2021

💼 Consulting

🤖 Artificial Intelligence

🔌 API

💰 $50M Series A on 2022-08

Consulting • Artificial Intelligence • API

Inworld AI is a developer-focused conversational AI platform that provides a realtime, provider-agnostic runtime and high-quality TTS for building expressive voice agents and virtual characters. It offers multilingual, low-latency streaming voice, instant cloning, emotion and non-verbal controls, and an API-based integration layer with templates and pipelines optimized for scale and cost. The platform is used across games, media, contact centers, and other interactive experiences to boost engagement and reduce infrastructure costs.

📋 Description

• Build first-party speech models and serve LLMs for realtime, consumer-facing applications • Develop and operate inference behind modular APIs for high-volume, realtime workloads • Optimize model serving for latency, throughput, and performance at scale • Containerize models and transition them from research into reliable production systems • Work with inference frameworks, distributed systems, Kubernetes, Ray, load balancing, and multi-GPU/multi-node infrastructure • Design benchmarks or prototypes to clarify ambiguous technical problems • Profile and optimize code running on NVIDIA GPUs • Contribute to systems programming, open-source inference engines, or technical write-ups • Collaborate with research and engineering teams to ship stable, high-impact systems

🎯 Requirements

• Deep understanding of modern serving frameworks and techniques such as vLLM or TRT-LLM • Hands-on experience with quantization, distillation, caching strategies, continuous batching, paged attention, and speculative decoding • Proficiency in C++, CUDA, Rust, or highly optimized Python • Ability to profile code and optimize NVIDIA GPU performance • Experience with Kubernetes, Ray, custom load balancing, multi-GPU/multi-node inference, and handling thousands of concurrent connections • Non-trivial systems programming projects, open-source contributions to major inference engines, or deep-dive technical write-ups • Ability to take a model from research through production deployment and reliability • PhD in CS, Physics, or Math, or equivalent practical experience building backend or ML systems • Must already have the legal right to work in the United Kingdom • Visa sponsorship is not available for this role

🏖️ Benefits

• Equity • Benefits • Potential future U.S. visa and relocation support for relocation to the San Francisco Bay Area, subject to business needs and applicable legal and work authorization requirements