Member of Technical Staff – ML Platform

🔥 12 hours ago

🇺🇸 United States – Remote

💵 $240k - $290k / year

⏰ Full Time

🔴 Lead

🖥 Software Engineer

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Runway

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2018

🤖 Artificial Intelligence

☁️ SaaS

📱 Media

Artificial Intelligence • SaaS • Media

Runway is a company building foundational "Real-World Intelligence" — large models and systems that can understand, simulate and act in the visual world. It offers three main product platforms built on these models: Runway Creative, an all‑in‑one cloud creative suite for generating and editing video, images and audio for individuals and teams; Runway Dev, an AI media platform and API for developers to run models, compose pipelines and trigger workflows; and Runway Robotics, a toolkit for photorealistic simulation, policy inference and synthetic data generation powered by their General World Model (GWM-1). Runway also publishes research (e. g. , GWM-1, Gen-4. 5 video model) and serves both individual creators and enterprise customers.

📋 Description

• Own the evaluation platform end to end, including tooling and systems to generate, annotate, review, and adapt evaluations at frontier scale • Define CLIs, APIs, GUIs, and storage layers to make evaluation seamless, fast, sophisticated, and collaborative • Work directly with research teams on video, image, audio, agents, and robotics to understand measurement needs and build generalized platform solutions • Set company-wide standards for model evaluation, including reproducibility, metric definitions, reporting formats, and result trustworthiness • Support adoption and integration of the platform across training, production model serving, and other research efforts • Contribute to ML Platform tools and systems that help Runway train and serve frontier models

🎯 Requirements

• 5+ years of experience building ML infrastructure or data platforms in production environments • At least some experience with evaluation, experimentation, or benchmarking systems • Strong Python and PyTorch skills • Hands-on experience running large batch GPU workloads on Kubernetes • Experience designing data pipelines and storage for large volumes of media or model outputs • Attention to versioning and reproducibility • Familiarity with experimental statistics, including paired comparisons, confidence intervals, multiple-comparison pitfalls, and inter-rater agreement • Comfort building internal tools end to end, from the command line to the browser • Ability to lead a broad technical area, gather requirements, set direction, make tradeoffs, and drive a roadmap • Familiarity with the full model development lifecycle: data, training, evaluation, and serving • Self-starter able to work embedded with research teams and move fast • Strong systems thinking and pragmatic approach to production reliability • Humility and open mindedness • Nice to have: experience building evaluation suites for generative models • Nice to have: hands-on work with LLM- or VLM-as-judge pipelines • Nice to have: experience with online experimentation platforms and connecting offline metrics to product outcomes • Nice to have: prior work evaluating agents or robotics policies

🏖️ Benefits

• Salary range of $240K–$290K for candidates in the U.S. • Access to best-in-class models, agents, GPUs, storage and cloud services • Equal opportunity workplace committed to diversity and inclusion