Staff / Principal Machine Learning Engineer

🕒 April 8

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Inworld AI

Inworld AI

51 - 200 employees

Founded 2021

🤖 Artificial Intelligence

🔌 API

🎮 Gaming

💰 $50M Series A on 2022-08

Artificial Intelligence • API • Gaming

Inworld AI is a developer-focused conversational AI platform that provides a realtime, provider-agnostic runtime and high-quality TTS for building expressive voice agents and virtual characters. It offers multilingual, low-latency streaming voice, instant cloning, emotion and non-verbal controls, and an API-based integration layer with templates and pipelines optimized for scale and cost. The platform is used across games, media, contact centers, and other interactive experiences to boost engagement and reduce infrastructure costs.

📋 Description

• Develop best-in-class real-time multimodal models and the orchestration platform optimized for thousands of queries per second. • Tackle unclear problems and find solutions that ensure performance, latency, and reliability as core product features. • Collaborate with global teams to design benchmarks or prototypes that uncover detailed insights on projects. • Ensure that all engineering outputs are stable and ship products that meet market needs.

🎯 Requirements

• Inference Optimization: Deep understanding of modern serving frameworks and techniques like vLLM or TRT-LLM. • Model Acceleration: Hands-on experience with quantization, distillation, caching strategies, continuous batching, paged attention, and speculative decoding. • High-Performance Systems: Proficiency in C++, CUDA, Rust, or highly optimized Python. You know how to profile code and squeeze every ounce of performance out of NVIDIA GPUs. • Distributed Systems & Scaling: Experience with Kubernetes, Ray, custom load balancing, multi-GPU/multi-node inference, and reliably handling thousands of concurrent connections. • Public work: Non-trivial systems programming projects, open-source contributions to major inference engines, or deep-dive technical write-ups. • Full-cycle ownership: You can take a model from the research team, containerize it, optimize its serving, and ensure it runs reliably in production. • Background: PhD in CS, Physics, Math, or equivalent practical experience building backend or ML systems. • Professional fluency in English (written and spoken) is required, as you will be collaborating daily with our US-based leadership and engineering teams.

🏖️ Benefits

• Health insurance • 401(k) matching • Flexible work hours • Paid time off • Remote work options

Apply Now