Software Engineer – BIS, Baseten Inference Stack

🕒 June 2

🏢🏡 San Francisco – Hybrid

💵 $180k - $360k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🧑‍💻 Full-stack Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Baseten

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2020

🤖 Artificial Intelligence

☁️ SaaS

🏢 Enterprise

💰 $8M Seed Round on 2022-04

Artificial Intelligence • SaaS • Enterprise

Baseten is a company that provides fast, scalable model inference services, designed for performance, security, and a delightful developer experience. They offer tools to streamline the entire development process, enabling high-throughput inference and fast deployment times. Baseten caters to enterprise companies by delivering robust, secure, and scalable model serving solutions, particularly useful for machine learning and AI model deployment. Their solutions allow organizations to efficiently manage model infrastructure while focusing on creating domain-specific models. Baseten supports open-source model packaging and offers autoscaling features to handle varying demand efficiently.

📋 Description

• Develop infrastructure and orchestration systems for deploying and managing large-scale distributed LLM inference • Work across the stack, from customer-facing features to low-level infrastructure components • Build platform capabilities related to routing, autoscaling, scheduling, observability, and runtime management • Improve the reliability, scalability, and usability of our inference stack • Collaborate closely with Model Performance engineers to make new inference optimizations broadly available to customers and easy to configure • Help define best practices around testing, release automation, benchmarking, and operational excellence • Debug complex production systems spanning Kubernetes, distributed runtimes, networking, and GPU workloads • Make thoughtful engineering tradeoffs balancing performance, reliability, operational simplicity, and developer experience • Own projects end-to-end: from architecture and implementation through deployment, monitoring, and iteration based on customer feedback

🎯 Requirements

• Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, or a related field • Strong background in distributed systems, backend infrastructure, or platform engineering • Experience building and operating production systems where reliability, latency, and scale are first-class concerns • Strong sense of developer experience: you think about how systems are used, not just how they work • Motivated and willing to learn new languages, frameworks, and systems as needed • Ability to debug complex systems across multiple layers of the stack • Genuine interest in inference engineering. You don’t need to have hands on experience but are willing to learn • Excellent communication and collaboration skills.

🏖️ Benefits

• Competitive compensation, including meaningful equity. • 100% coverage of medical, dental, and vision insurance for employee and dependents • Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!) • Paid parental leave • Fertility and family-building stipend through Carrot • Company-facilitated 401(k) • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.