Machine Learning Engineer, Reliability

๐Ÿ•’ July 28

Where this job comes from

Posted on fal's careers page โ†—fal's careers page, not through a job board

First seen by Remote Rocketship July 28

Still open on fal's site. Checked 3 hours ago.

Apply Now
Logo of fal

fal

51 - 200 employees

๐Ÿค– Artificial Intelligence

๐Ÿ”Œ API

โ˜๏ธ SaaS

Artificial Intelligence โ€ข API โ€ข SaaS

fal is a generative media platform for developers that provides access to a large gallery of production-ready image, video, audio and 3D generative models alongside serverless GPU inference and on-demand compute clusters for training and fine-tuning. The platform offers unified APIs and SDKs to call hundreds of open models or private weights, a high-performance inference engine, managed serverless GPU deployments, and dedicated clusters with modern NVIDIA hardware for large-scale training. fal targets developer and enterprise customers with features like SOC 2 compliance, private endpoints, usage analytics, and enterprise support, and is positioned for building, deploying, and scaling generative AI-powered products.

๐Ÿ“‹ Description

โ€ข Own availability, latency, and throughput SLOs across a large fleet of generative media model APIs serving production traffic at scale โ€ข Build the monitoring, alerting, and observability needed to catch ML-specific failures, output quality degradation, pipeline breakage, model regressions before customers do โ€ข Harden model deployment workflows with canary releases, shadow testing, automated rollbacks, and validation gates so new model versions ship safely โ€ข Drive the security posture of the model fleet: secure model serving, abuse and misuse detection, rate limiting, and protection against adversarial usage patterns โ€ข Operationalize safety systems for generative media, content moderation pipelines, safety classifiers, and guardrails that run reliably at inference time without compromising performance โ€ข Lead incident response for model API outages and degradations, run postmortems, and drive the engineering work that prevents recurrence โ€ข Improve capacity planning, autoscaling, and GPU fleet efficiency for inference workloads under highly variable traffic โ€ข Partner with model and infrastructure teams to make reliability, security, and safety requirements part of how new models get onboarded to the platform

๐ŸŽฏ Requirements

โ€ข 3+ years of professional experience, with 1 year experience operating production ML or high-scale API systems, ideally with on-call ownership โ€ข Strong systems fundamentals: distributed systems, networking, observability, and incident management โ€ข Working knowledge of modern generative models (diffusion, transformers) and their failure modes in production โ€ข Familiarity with security and safety practices for ML systems ,abuse prevention, content safety, or trust & safety engineering experience is a strong plus โ€ข A bias toward automation, measurement, and blameless postmortems

๐Ÿ–๏ธ Benefits

โ€ข You will have access to our massive GPU cluster for inference and evaluation โ€ข Some core technologies we use include Python, torch, diffusers, Kubernetes, and the fal Python SDK

Apply Now

๐Ÿ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

๐Ÿ•’ July 27

QuantumLoopAi

51 - 200

๐Ÿฅ Healthcare

๐Ÿค– Artificial Intelligence

โ˜๏ธ SaaS

Senior Azure DevOps Engineer responsible for managing and optimising Azure cloud infrastructure. Join QuantumLoopAI, a healthtech company scaling its AI-platform solutions.

๐Ÿ•’ July 26

AVAHI

1 - 10

๐Ÿ’ผ Consulting

๐Ÿฅ Healthcare

๐Ÿฝ๏ธ Food & Beverage

AWS DevOps Engineer joining Avahi to manage cloud infrastructure and drive modernization initiatives. Collaborating with global teams while fostering a culture of learning and innovation.

๐Ÿ•’ July 24

HighLevel

201 - 500

๐Ÿ’ผ Consulting

๐Ÿ“ฆ Logistics

โ˜๏ธ SaaS

Senior DevOps Engineer driving cloud cost optimization strategies across GCP, AWS, and Firebase. Collaborating with teams to improve resource efficiency and organizational impact.

๐Ÿ•’ July 14

Zact

11 - 50

๐Ÿ’ณ Fintech

๐Ÿ’ธ Finance

๐Ÿค B2B

Cloud DevSecOps Engineer securing GCP infrastructure, CI/CD pipelines, and compliance for Zactโ€™s fintech payment and expense management platform.

๐Ÿ•’ July 8

Pythian

201 - 500

๐Ÿ’ผ Consulting

๐Ÿฅ Healthcare

๐Ÿญ Manufacturing

Site Reliability Engineer operating Kubernetes, cloud, and AI/ML infrastructure for Pythianโ€™s data and analytics services. Automating workflows and building resilient monitoring systems.

Built byย Lior Neu-ner. I'd love to hear your feedback โ€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok