Senior Staff Machine Learning Systems Engineer

🔥 0 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

hims & hers

WebsiteLinkedInAll Job Openings

201 - 500 employees

Founded 2017

🏥 Healthcare

💼 Consulting

📣 Marketing

Healthcare • Consulting • Marketing

Hims & Hers is an online platform with over 1 million subscribers that connects patients to licensed healthcare professionals across all 50 states in the U. S. The service offers comprehensive support for sexual health, weight loss, hair regrowth, mental health, and skincare through a 100% online process. Clients can receive personalized treatment plans which may include prescription medications, and benefit from free and discreet shipping. Hims & Hers prides itself on providing accessible and affordable healthcare without the need for insurance, offering transparent pricing and support from licensed providers. It aims to empower individuals by making healthcare and treatment conveniently available on their own terms, including mental health support, which includes treatments for anxiety and depression.

📋 Description

• Set technical direction for evaluation systems, including metric, judge, scorer, statistical methodology, and failure-tracking infrastructure • Design and scale ingestion, transformation, dataset-versioning, labeling, and calibration pipelines • Address scaling and complexity challenges in AI evaluation • Define evaluation approaches for new AI services • Lead multi-team initiatives replacing manual review with statistically sound automated gates • Own adversarial and red-team evaluation programs, test suites, and failure taxonomies • Resolve cross-team technical disagreements and drive alignment across engineering, product, and AI leadership • Develop reusable evaluation methodologies and standards • Take ambiguous cross-team problems from concept through fully specified production systems • Lead major platform improvements and modernization of core systems • Build relationships across ML engineering, data science, platform engineering, clinical, legal, and product teams • Share evaluation and data-pipeline knowledge through talks and written documentation • Mentor engineers, including experienced and senior engineers

🎯 Requirements

• 10+ years of experience in ML infrastructure, data engineering, or evaluation/testing systems • Hands-on experience designing and calibrating LLM judges and scorers • Experience building statistically sound regression-testing methodology, including paired significance testing and correction for multiple comparisons • Experience measuring agreement against human labels • Experience designing adversarial and red-team evaluation approaches • Hands-on experience with dataset versioning, feature and benchmark pipelines, labeling and calibration workflows, and high-throughput ingestion and transformation systems • Track record of building standards adopted by broader groups • Experience leading multi-team projects to completion and resolving technical disagreements • Track record of mentoring engineers, including senior engineers • Excellent communication and ability to adapt technical ideas for different audiences • Strong Python skills • Statistical fluency sufficient to design and defend production testing frameworks • Experience with Databricks, MLflow, Unity Catalog, or similar platforms preferred • Experience building reporting tools for non-technical teams preferred • Prior regulated-industry experience preferred • Company-wide talks or write-ups that influenced other teams preferred • Must be legally authorized to work in the U.S. without restriction for any employer • Must not require current or future immigration sponsorship by Hims & Hers to work in the U.S.

🏖️ Benefits

• Competitive salary and equity compensation for full-time roles • Unlimited PTO • Company holidays • Quarterly mental health days • Comprehensive medical, dental, and vision benefits • Parental leave • Employee Stock Purchase Program (ESPP) • 401k benefits with employer matching contribution • Offsite team retreats • Flexible/remote work approach • Reasonable accommodations for qualified individuals with disabilities and disabled veterans