Senior Applied ML Engineer – Model Router

πŸ•’ November 4

πŸ‡ΊπŸ‡Έ United States – Remote

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ€– Machine Learning Engineer

Where this job comes from

Posted on Cast AI's careers page β†—Cast AI's careers page, not through a job board

First seen by Remote Rocketship November 4

Still open on Cast AI's site. Checked 1 hour ago.

Apply Now
Logo of Cast AI

Cast AI

201 - 500 employees

Founded 2019

☁️ SaaS

πŸ€– Artificial Intelligence

🀝 B2B

SaaS β€’ Artificial Intelligence β€’ B2B

Cast AI is a SaaS platform that automates Kubernetes application performance, infrastructure, and cost optimization for cloud-native teams. It connects to EKS/AKS/GKE and on-prem clusters with no code changes, uses predictive models and runtime signals to rightsize pods, scale nodes, optimize GPUs and Spot instances, and run approved self-healing runbooks to maintain reliability and reduce cloud spend. Cast AI targets platform, SRE, and FinOps teams and supports AI/LLM workloads, GPU optimization, and real-time workload placement and cost intelligence.

πŸ“‹ Description

β€’ Own the routing model end to end, including features, objective, training, calibration, and release cadence β€’ Build production-parity evaluations, router-vs-router comparisons, task-family holdouts, and error-barred pass-rate analyses β€’ Convert production outcomes, benchmark rollouts, and override feedback into training signals β€’ Categorize failures into infrastructure and task failures to prevent poisoned labels from reaching the policy β€’ Model task success, token cost, wall-clock speed, concurrency, and cached-input economics β€’ Run shadow deployments, A/B tests, full rollouts, drift monitoring, and retraining β€’ Develop calibrated decisions, abstention under uncertainty, and speed-aware routing β€’ Partner with platform engineers on instrumentation, per-request features and labels, and experiment data paths

🎯 Requirements

β€’ 5+ years in applied ML or ML research β€’ Experience training, evaluating, and shipping models that make real-time decisions, such as ranking, recommendation, bandits, pricing, or LLM routing β€’ Strong Python and SQL at scale, including handling millions of request-level records β€’ Ability to distinguish model improvement from easier evaluation β€’ Understanding of LLM benchmarks and agentic harnesses β€’ Knowledge of TTFT, decode speed, batching, prefix caching, and concurrency β€’ Experience instrumenting systems and using error bars β€’ Python, PyTorch, SQL at scale (ClickHouse), OpenAI-compatible and Anthropic-compatible LLM APIs, benchmark and rollout harnesses, and GitLab CI β€’ Background check may be conducted at the final stage β€’ Must be able to work without visa sponsorship or a work permit provided by Cast AI

πŸ–οΈ Benefits

β€’ Competitive salary (depending on the level of experience) β€’ Flexible, remote-first global environment β€’ Equity options β€’ 10% of work time for personal projects or self-improvement β€’ Learning budget for professional and personal development, including access to international conferences and courses β€’ Annual hackathon β€’ Team-building budget and company events β€’ Equipment budget β€’ Extra days off β€’ Quick feedback with a fast-paced workflow

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ November 4

EvolutionIQ

51 - 200

πŸ₯ Healthcare

πŸ’Ό Consulting

πŸ“¦ Logistics

Senior ML Engineer building statistical and LLM models for CCC's auto casualty claims platform. Evaluating AI performance and measuring customer impact.

πŸ•’ November 4

QuinStreet

501 - 1000

πŸ›οΈ eCommerce

πŸ“£ Marketing

Senior Machine Learning Engineer advancing ranking, recommendation, and personalization algorithms. Building measurable, resilient ML systems for QuinStreet’s digital performance marketplaces.

πŸ•’ November 4

Virta Health

201 - 500

πŸ₯ Healthcare

βš•οΈ Healthcare Insurance

🧘 Wellness

Senior ML Engineer building production ML models for Virta Health’s virtual diabetes and obesity care platform. Improving personalized coaching, experimentation, and member outcomes.

πŸ•’ November 4

Airbnb

5001 - 10000

✈️ Travel

πŸ“¦ Logistics

πŸ›οΈ eCommerce

Senior Machine Learning Engineer building scalable ranking models and infrastructure. Improving Airbnb search and recommendations across structured and unstructured data.

πŸ•’ November 3

Babylist

51 - 200

πŸ›οΈ eCommerce

πŸ›’ Retail

Staff Machine Learning Engineer shaping recommendations and personalization across Babylist’s family registry experience. Building ML systems for feeds, search, product discovery, and its AI registry assistant.

Developed byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok