Senior Principal Software Engineer, Machine Learning

🔥 0 minutes ago

🇺🇸 United States – Remote

💵 $222k - $453k / year

⏰ Full Time

🟠 Senior

🤖 Machine Learning Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Toast

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 2013

🍽️ Food & Beverage

💼 Consulting

📦 Logistics

Food & Beverage • Consulting • Logistics

Toast is a technology company that specializes in providing integrated software and hardware solutions for the restaurant industry. Their offerings include a comprehensive restaurant management platform that features point of sale (POS) systems, payment processing, online ordering, payroll management, and various operational tools designed to streamline restaurant operations. Toast's platform is tailored to meet the needs of diverse restaurant types, including quick service, full service, fast casual, fine dining, cafes, and food trucks. They also provide resources like industry insights and educational materials to support restaurant success.

📋 Description

• Own the technical direction of the ML Platform, including feature store, model hosting and serving, experimentation, and training infrastructure • Drive architectural decisions around scalability, reliability, latency, and cost • Lead design and delivery of large-scope platform initiatives from conception through production • Coordinate across ML, data, and infrastructure teams • Identify and resolve systemic challenges involving online/offline feature parity, model deployment, experimentation velocity, GPU utilization, and cross-team dependencies • Maintain a high engineering quality bar through hands-on code contributions, design reviews, and mentorship • Partner with ML engineering, data science, product, and platform leadership to translate ML strategy into technical roadmaps • Define paved paths for safe model shipping, including feature registration, canary rollout, monitoring, and rollback • Leverage AI-augmented development tools to increase development velocity and code quality

🎯 Requirements

• 10+ years delivering complex backend or infrastructure systems at scale • Direct experience building or operating core ML infrastructure, such as feature stores, model serving, experimentation platforms, or training orchestration • Mastery of a modern backend language, ideally Java or Kotlin • Deep proficiency with distributed systems concepts, including consistency, latency, throughput, fault tolerance, and observability • Strong understanding of data modeling, query languages, and online/offline data patterns underpinning ML systems • Demonstrated technical leadership and ability to drive cross-team alignment and influence engineering, product, and business stakeholders • Bachelor's degree in Computer Science or a related field, or equivalent practical experience • Nice-to-have experience with ML platform components such as Tecton, MLflow, SageMaker, or Databricks • Nice-to-have experience building experimentation or A/B testing platforms at scale • Nice-to-have familiarity with Kafka, Flink, or Spark Streaming • Nice-to-have experience serving LLMs or deep-learning models in production, GPU capacity planning, and inference optimization • Nice-to-have experience supporting internal-developer-facing platforms with a product mindset

🏖️ Benefits

• Competitive compensation and benefits programs • Cash compensation, including overtime and bonus/commissions if eligible • Equity • Flexible work arrangements / hybrid work model valuing individual needs • AI tools provided across disciplines to support faster, more independent, higher-quality work • Reasonable accommodations for persons with disabilities