Staff Software Engineer – Serverless

🕒 April 29

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Runware

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2023

🤖 Artificial Intelligence

🔌 API

📱 Media

Artificial Intelligence • API • Media

Runware is a flexible generative AI platform that specializes in high-quality media creation for images and videos through an affordable and fast API. It is capable of advanced tasks such as image generation, video inference, upscaling, and background removal, making it an essential tool for developers seeking to enhance their projects with AI technology. Powered by a custom Sonic Inference Engine™ and renewable energy, Runware ensures quick and efficient media generation without requiring complex infrastructure or machine learning expertise.

📋 Description

• Build the core systems behind Runware’s serverless platform, including workload execution, routing, scheduling, isolation and scaling leveraging our inference engine • Make it simple for developers to deploy models and run AI workloads without managing GPUs, servers, queues or infrastructure through a simple SDK interface • Design and improve the control plane for serverless execution, including APIs, workers, lifecycle management, retries and failure handling • Work closely with our infrastructure and ML teams to improve workload startup time, GPU utilisation, model warm-up, caching and placement • Build observability that makes serverless workloads easy to monitor, debug and operate at scale globally • Lead the technical design, mentor other engineers and help define the engineering standards for a new product area

🎯 Requirements

• Strong experience as a Staff Engineer, Senior Software Engineer, Backend Engineer, Platform Engineer or similar • Experience building backend services, distributed systems, developer platforms or workload orchestration systems • Strong understanding of async processing, queues, scheduling, retries, back pressure and failure handling • Comfortable working across APIs, control planes, workers, databases and observability systems • Strong engineering fundamentals in one or more backend languages such as Python, Go or similar • Good judgement around trade-offs between reliability, latency, scale, cost and developer experience • Clear communication, strong ownership and the ability to lead technical direction in a fast-moving environment • Nice to have • Experience building serverless platforms, job execution systems, container platforms or compute orchestration systems • Experience with GPU-backed workloads, AI/ML inference, model serving, batch processing or high-performance compute • Familiarity with technologies such as vLLM, TensorRT, Triton, Kubernetes, Nomad or Knative • Experience improving workload performance through batching, autoscaling, model warm-up, caching, request routing or queue management • Experience with multi-tenant isolation, sandboxing, quotas, rate limits, resource accounting or usage-based billing

🏖️ Benefits

• Generous paid time off – vacation, sick days, public holidays • Meaningful stock options – share in the upside you create • Remote-first setup – work from home anywhere we can employ you • Flexible hours – own your schedule outside core collaboration blocks • Family leave – paid maternity, paternity, and caregiver time • Company retreats – twice-yearly gatherings in inspiring locations