
51 - 200 employees
Founded 2022
๐ค Artificial Intelligence
โ๏ธ SaaS
๐ค B2B
๐ฐ $20M Seed on 2024-06
Artificial Intelligence โข SaaS โข B2B
Runpod is a cloud platform that provides on-demand GPU compute and managed infrastructure tailored for AI development and deployment. It offers GPU "Pods" across 31 global regions, serverless GPU endpoints for low-latency inference, multi-node GPU clusters for distributed training, and a hub for deploying open-source models and templates. Runpod emphasizes fast startup (sub-200ms cold starts), autoscaling from zero to thousands of workers, support for 30+ GPU SKUs, and tooling for the full AI lifecycle from experiment to production, targeting developers and enterprise AI teams.
๐ September 25
๐บ๐ธ United States โ Remote
๐ต $150k - $220k / year
โฐ Full Time
๐ก Mid-level
๐ Senior
๐ค Machine Learning Engineer
๐ป Ghost score 20%
Where this job comes from
Posted on Runpod's careers page โ, not through a job board
First seen by Remote Rocketship September 25
Still open on Runpod's site. Checked 2 hours ago.

51 - 200 employees
Founded 2022
๐ค Artificial Intelligence
โ๏ธ SaaS
๐ค B2B
๐ฐ $20M Seed on 2024-06
Artificial Intelligence โข SaaS โข B2B
Runpod is a cloud platform that provides on-demand GPU compute and managed infrastructure tailored for AI development and deployment. It offers GPU "Pods" across 31 global regions, serverless GPU endpoints for low-latency inference, multi-node GPU clusters for distributed training, and a hub for deploying open-source models and templates. Runpod emphasizes fast startup (sub-200ms cold starts), autoscaling from zero to thousands of workers, support for 30+ GPU SKUs, and tooling for the full AI lifecycle from experiment to production, targeting developers and enterprise AI teams.
โข Define inference performance measurements, including throughput, time to first token, inter-token latency, and cost per token โข Build tooling that makes performance measurements rigorous and repeatable โข Profile and diagnose performance problems across the serving stack, from scheduling and memory management to kernels and interconnect โข Improve serving efficiency for large, state-of-the-art models on single-node and multi-node GPU deployments โข Turn findings into production-ready runtimes, configurations, and defaults โข Collaborate with product and infrastructure teams to shape how inference is offered on Runpod โข Monitor the fast-moving inference ecosystem and evaluate what to adopt, build, or contribute back โข Trace serving engine/runtime bottlenecks and implement fixes when configuration tuning is insufficient โข Own LLM serving performance end to end across models, hardware generations, and workloads
โข 5+ years of professional system engineering experience โข Deep, hands-on experience with vLLM, SGLang, or a comparable serving engine in production or at serious benchmark scale โข Strong software engineering skills in Python โข Comfortable working in large, performance-critical codebases โข Solid understanding of LLM inference performance, including batching, memory, parallelism, and latency-throughput trade-offs โข Experience with inference optimization techniques such as quantization, speculative decoding, or distributed serving โข Rigor in benchmarking and performance analysis โข Comfort with GPU profiling tools โข Ability to explain results clearly in writing and turn them into decisions โข Eligible to work in the United States โข Must not require employment visa sponsorship โข Preferred: experience writing or tuning GPU kernels in CUDA or Triton โข Preferred: contributions to inference or ML systems projects โข Preferred: experience with multi-node GPU systems and high-speed networking โข Preferred: experience at a company where inference cost and latency were core business metrics
โข Meaningful equity in a fast-growing company; everyone on the team receives stock options โข Generous medical, dental & vision plans โข Flexible PTO โข Remote work-first arrangement โข $1,200 Home Office & Equipment Stipend โข Passionate team on the cutting edge of AI infrastructure, with culture, learning, and ownership at the heart of how the company scales
Apply NowImprove your chances of getting an interview by checking your resume score before you apply.
๐ September 23
AI/ML Engineer building production GenAI, computer vision, and data systems for Slateโs affordable customizable vehicles. Applying AI across manufacturing, supply chain, and physical operations.
๐บ๐ธ United States โ Remote
๐ต $123.3k - $185k / year
โฐ Full Time
โช๏ธ Entry-level
๐ข Junior
๐ก Mid-level
๐ค Machine Learning Engineer
๐ฆ H1B Visa Sponsor
๐ September 23
ML Engineer II building production AI agents and LLM applications for Press Ganey, a healthcare experience measurement and analytics provider. Integrating advanced AI capabilities into Java/Spring enterprise platforms.
๐บ๐ธ United States โ Remote
๐ต $110k - $130k / year
โฐ Full Time
๐ข Junior
๐ก Mid-level
๐ค Machine Learning Engineer
๐ฆ H1B Visa Sponsor
๐ September 23
Staff ML Engineer scaling production AI agents for Press Ganey, a healthcare experience measurement and analytics provider. Leading enterprise AI architecture across Java/Spring platforms and distributed systems.
๐ September 22
Staff ML Engineer building ranking, targeting, and recommendation systems for Discordโs Shop, Nitro, subscriptions, and gifting. Scaling ML platforms and revenue products for a global gaming community.
๐บ๐ธ United States โ Remote
๐ต $272k - $340k / year
๐ฐ $12G Venture Round on 2022-03
โฐ Full Time
๐ Senior
๐ค Machine Learning Engineer
๐ฆ H1B Visa Sponsor
๐ September 21
Principal Audio DSP/ML Engineer developing Bose audio algorithms for speech, acoustics, and consumer devices. Combining machine learning, deep learning, and digital signal processing for production hardware.
๐บ๐ธ United States โ Remote
๐ต $216k - $297k / year
๐ฐ $430.2k Equity crowdfunding on 2017-12
โฐ Full Time
๐ Senior
๐ด Lead
๐ค Machine Learning Engineer
๐ฆ H1B Visa Sponsor