Software Engineer – Model Performance

🕒 March 27

🏢🏡 San Francisco – Hybrid

💵 $180k - $360k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🧑‍💻 Full-stack Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 65%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Baseten

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2020

🤖 Artificial Intelligence

☁️ SaaS

🏢 Enterprise

💰 $8M Seed Round on 2022-04

Artificial Intelligence • SaaS • Enterprise

Baseten is a company that provides fast, scalable model inference services, designed for performance, security, and a delightful developer experience. They offer tools to streamline the entire development process, enabling high-throughput inference and fast deployment times. Baseten caters to enterprise companies by delivering robust, secure, and scalable model serving solutions, particularly useful for machine learning and AI model deployment. Their solutions allow organizations to efficiently manage model infrastructure while focusing on creating domain-specific models. Baseten supports open-source model packaging and offers autoscaling features to handle varying demand efficiently.

📋 Description

• Implement, refine, and productionize cutting-edge techniques (quantization, speculative decoding, kv cache reuse, chunked prefill and LoRA) for ML model inference and infrastructure. • Deep dive into underlying codebases of TensorRT, PyTorch, TensorRT-LLM, vllm, sglang, CUDA, and other libraries to debug ML performance issues. • Apply and scale optimization techniques across a wide range of ML models, particularly large language models. • Collaborate with a diverse team to design and implement innovative solutions. • Own projects from idea to production.

🎯 Requirements

• Bachelor's, Master's, or Ph.D. degree in Computer Science, Engineering, Mathematics, or related field. • Experience with one or more general-purpose programming languages, such as Python or C++. • Familiarity with LLM optimization techniques (e.g., quantization, speculative decoding, continuous batching). • Strong familiarity with ML libraries, especially PyTorch, TensorRT, or TensorRT-LLM. • Demonstrated interest and experience in LLM’s. • Deep understanding of GPU architecture. • Proficiency in enhancing the performance of software systems, particularly in the context of large language models (LLMs) (Bonus). • Experience with CUDA or similar technologies (Bonus). • Deep understanding of software engineering principles and a proven track record of developing and deploying AI/ML inference solutions (Bonus). • Experience with Docker and Kubernetes (Bonus).

🏖️ Benefits

• Competitive compensation, including meaningful equity. • 100% coverage of medical, dental, and vision insurance for employee and dependents • Generous PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!) • Paid parental leave • Company-facilitated 401(k) • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.