Search Remote Jobs

Backend Engineer, Multi-cloud Inference Platform

🕒 November 3

🌐 United States, Canada – Remote

infoinfo

🏄 California – Remote

infoinfo

💵 $180k - $270k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🔙 Backend Engineer

Where this job comes from

Posted on Modular's careers page, not through a job board

First seen by Remote Rocketship November 3

Still open on Modular's site. Checked 24 minutes ago.

Logo of Modular

Modular

51 - 200 employees

🤖 Artificial Intelligence

🏢 Enterprise

💰 $100.5G Series B on 2023-08

Artificial Intelligence • Enterprise

Modular is the next-generation AI developer platform unifying the development and deployment of AI for the world. The company focuses on enabling AI to be accessible to anyone, anywhere, leveraging specialties in machine learning, AI technologies, and platforms such as TensorFlow and PyTorch, along with hardware solutions.

📋 Description

• Build the multi-cloud, multi-tenant platform powering Modular’s inference services • Build fault-tolerant, low-toil services using resources across Tier 1 cloud providers and neoclouds • Improve operational excellence through request-to-kernel observability, multi-cloud deployments, cold-start optimizations, and more • Build Helm charts and Kubernetes operators for simple, effective, maintainable deployments • Work on end-to-end distributed LLM inference deployments • Help create a repeatable, observable, productive, low-toil platform for managing inference deployments • Travel to team building events 2-4 times a year

🎯 Requirements

• Candidates based in the US or Canada are welcome to apply • 5+ years of experience working in backend engineering • Experience with service oriented architecture and distributed systems • Experience with cloud providers (AWS, GCP, Azure, neoclouds) • Experience with Kubernetes and operating your own services • Experience in machine learning technologies and use cases • Bachelor's degree in Engineering, Information Systems, Computer Engineering, Electrical Engineering, Computer Science, or related field and 4+ years of Software Engineering or related work experience; OR Master's degree and 3+ years; OR PhD and 2+ years • 2+ years of work experience with a programming language such as Python, Mojo, Rust, C++, etc. • Practical experience implementing and maintaining security in multi-tenancy environments is helpful but not required • Experience working on high-scale ML inference infrastructure is helpful but not required • Familiarity with Golang is helpful but not required • Must be authorized to work in the U.S. as described through E-Verify

🏖️ Benefits

• Comprehensive healthcare coverage • Retirement and savings programs • Employee stock purchase opportunities • Paid time off • Wellbeing resources • Family support programs • Learning and development opportunities • RSU grants • Regular team onsites and local meetups • Travel to team building events 2-4 times a year

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 November 3

Accenture Federal Services

10,000+ employees

💼 Consulting

🎖️ Defense

📦 Logistics

Azure integration architect leading secure, compliant API and event-driven platforms. Supporting Accenture Federal Services’ mission to modernize US federal government technology.

🕒 November 3

Tekmetric

51 - 200

🚘 Automotive

🤝 B2B

Senior Backend Engineer building scalable Java services for Tekmetric’s cloud-based auto-repair shop software. Collaborating across agile teams to deliver performant features and mentor engineers.

🕒 November 3

Zip Co

1001 - 5000

💳 Fintech

🛍️ eCommerce

💸 Finance

Senior backend engineer building Zip’s card issuing, transaction processing, and settlement systems. Designing reliable distributed services and applying AI-assisted development across the payments lifecycle.

🕒 November 3

Aquila

1001 - 5000

☁️ SaaS

🏢 Enterprise

Intermediate .NET Developer modernizing financial software for U.S. Housing Finance Agencies. Leading .NET backend architecture, APIs, databases, and legacy replatforming.

🕒 November 3

Aquila

1001 - 5000

☁️ SaaS

🏢 Enterprise

Intermediate .NET Developer modernizing financial software for U.S. Housing Finance Agencies. Leading backend architecture, APIs, databases, and legacy application replatforming.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok