Lead Software Platform Engineer, MLOps

🔥 3 hours ago

🏄 California, Massachusetts – Remote

🏄 California – Remote 🍂 Massachusetts – Remote

💵 $200k - $270k / year

⏰ Full Time

🟠 Senior

🏗️ Platform Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

TetraScience

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2015

🏥 Healthcare

💼 Consulting

📦 Logistics

Healthcare • Consulting • Logistics

TetraScience is a company dedicated to transforming raw scientific data into AI-native datasets for advanced scientific applications. By collaborating closely with leading biopharmaceutical companies, TetraScience enhances productivity, accelerates insights, and ensures data integrity across the scientific value chain. Their platform offers solutions for next-generation lab data management, AI-driven scientific outcomes, and compliance with industry standards. As the first company to provide a data and AI cloud built specifically for science, TetraScience enables its clients to liberate, unify, and transform their data, overcoming traditional data silos and boosting scientific productivity by providing a flexible, open, and collaborative infrastructure.

📋 Description

• Own the technical architecture of the AI/ML platform and its customer-facing service and API surface. • Own the end-to-end model and prompt lifecycle across Databricks MLflow and AWS Bedrock, including registration, versioning, staged promotion, rollback, and multi-model serving. • Design inference infrastructure for real-time and batch AI workloads, including routing, batching, caching, concurrency control, GPU capacity planning, large binary inputs, and graceful degradation. • Integrate AI models and LLMs into production systems using RAG, tool and function calling, MCP-based tooling, and agent runtimes. • Design platform security, including guardrails, prompt-injection and tool-abuse defenses, PII and PHI handling, and tenant data boundaries. • Build AI evaluation and quality infrastructure, including offline and online evaluation harnesses, golden datasets, CI regression gates, A/B and shadow deployment, and drift and hallucination detection. • Establish monitoring, alerting, logging, distributed tracing, and SLI/SLO/SLA practices for the AI platform. • Design reproducibility and lineage for validated pharma environments, including versioned data, code, prompts, and model artifacts and audit trails. • Contribute to infrastructure-as-code and deployment automation using CloudFormation and AWS CDK. • Own production readiness with Applied AI, data engineering, and platform teams, including performance, reliability, cost efficiency, incident response, and runbooks. • Act as SME and design authority, lead design reviews, write reference architectures and technical documentation, and mentor engineers. • Evaluate emerging AI infrastructure frameworks, serving runtimes, model providers, and data types, making build-versus-buy decisions.

🎯 Requirements

• 10+ years of professional experience in software engineering and infrastructure engineering designing, building, and scaling distributed cloud-native production systems. • Proven technical leadership or architecture experience with accountability for system design, scalability, performance, and cost optimization. • Experience designing security into multi-tenant platforms, including tenant authorization boundaries and PII/PHI handling. • Awareness of LLM-specific risks such as prompt injection and tool abuse. • Extensive production experience building AI/ML infrastructure as a multi-tenant product for external users. • Deep hands-on experience taking LLM-based systems to production, including RAG, retrieval and embedding design, prompt and model versioning, and tool or function calling. • Expert-level TypeScript and Python coding skills for robust APIs and backend services. • Production experience with model registries and serving stacks, ideally Databricks MLflow. • Experience with AI evaluation release gates, regression gates, and drift or quality monitoring. • Proficiency in API-first design, REST, and OpenAPI. • Solid AWS and Docker knowledge. • Familiarity with CloudFormation or AWS CDK, CI/CD pipelines, and deployment automation. • Experience defining observability and SLI/SLO/SLA practices, including monitoring, alerting, and distributed tracing. • Ability to communicate with customers and cross-functional teams, influence technical direction, and mentor engineers. • Nice to have: emerging LLM frameworks, production agentic orchestration, MCP, LLM cost monitoring, multimodal inputs, fine-tuning or model optimization, regulated or validated environments, and scientific or life sciences domains. • Visa sponsorship is not currently provided for this position.

🏖️ Benefits

• 100% employer-paid benefits for all eligible employees and immediate family members • Unlimited paid time off (PTO) • 401K • Flexible working arrangements - Remote work • Company paid Life Insurance, LTD/STD • A culture of continuous improvement where you can grow your career and get coaching