Senior AI Engineer

πŸ•’ June 25

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $190k - $250k / year

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ€– AI Engineer

Where this job comes from

Posted on Atria Institute's careers page β†—Atria Institute's careers page, not through a job board

First seen by Remote Rocketship June 25

Still open on Atria Institute's site. Checked Yesterday.

Apply Now
Logo of Atria Institute

Atria Institute

51 - 200 employees

πŸ₯ Healthcare

βš•οΈ Healthcare Insurance

πŸ”¬ Science

Healthcare β€’ Healthcare Insurance β€’ Science

Atria Institute is leading a movement towards proactive, preventive health care by integrating cutting-edge science and technology into medicine. Comprising the Atria Academy of Science & Medicine, a team of multidisciplinary experts, and the Atria Health Collaborative, a nonprofit organization, Atria seeks to transform health care delivery both locally and globally. The institute offers personalized, coordinated health care and predictive testing, focusing on advanced screening for diseases. Atria is dedicated to translating scientific research into real-time medical applications and implementing proven interventions for preventable diseases.

πŸ“‹ Description

β€’ Architect and ship production AI systems end-to-end (orchestration, retrieval, inference, evaluation, and monitoring) for clinical decision support, document understanding, and agentic medical companions. β€’ Design agentic workflows with custom skills and harnesses, using frontier LLMs and self-hosted models where appropriate, and resisting the urge to reach for an agent when a function call would do. β€’ Lead development of structured information extraction pipelines from clinical documents, including automated verification systems and human-in-the-loop gates, where necessary. β€’ Build robust evaluation infrastructure (golden datasets, LLM-as-judge, regression tests, online A/B evaluation) that gates every model and prompt change. Accuracy, safety, cost, and latency are first-class metrics. β€’ Engineer for latency and cost: streaming, caching, prompt compression, model routing, and inference-cost budgets. β€’ Own production health: trace- and span-level observability, prompt versioning, drift detection, cost monitoring, replay-from-production for debugging, PHI-safe logging throughout, and the general art of finding out something is broken before a clinician does. β€’ Operationalize models trained by the AI Scientist team: serving, evaluation in production, rollback paths, and the feedback loops that turn real usage into training and eval data, rather than into a Slack thread nobody reads. β€’ Partner with clinicians, the data engineering team, and our research collaborators to translate clinical requirements into specifications and deliverable systems. β€’ Educate and mentor PMs and engineers across Atria on applied AI best practices, from prompt and evaluation design to choosing the right model for the job (which, surprisingly often, is not the largest one). β€’ Set technical direction for AI engineering at Atria: architecture decisions, build-vs-buy calls, and the evaluation and observability standards the team actually works to. β€’ Raise the bar on engineering practices, code review, observability, and incident response. Quietly, persistently, and with grace. β€’ Drive vendor and partner technical due diligence for AI/ML vendors: BAA scope, PHI handling, sub-processor obligations, and IP terms. β€’ Mentor other AI engineers through code review, design docs, and architecture decisions, with the patient conviction that good systems are made twice: once badly, then properly.

🎯 Requirements

β€’ A bias to ship. You would rather have a rough thing in production tomorrow that you can measure and improve than a beautiful thing in a design doc next quarter. β€’ A scrappy streak. You can pick up an unfamiliar tool, framework, or clinical concept on a Wednesday and have something working with it by Friday. β€’ A serious drive to keep getting better. You read other people's code, papers, and post-mortems. You treat being wrong as cheap information rather than an event. β€’ Hands-on experience building and operating LLM-powered or production ML systems: 4+ years. β€’ Strong Python skills and deep familiarity with at least one production backend framework (FastAPI, Flask, etc.). β€’ Hands-on experience with LLM orchestration, function/tool calling, and retrieval system design: chunking, hybrid search, reranking, and the rest of the unfashionable middle bit that makes RAG actually work. β€’ Working knowledge of a cloud data warehouse (Snowflake strongly preferred) and modern data tooling such as dbt, Dagster, or Airflow. β€’ A track record of designing evaluation systems for LLM applications β€” including the ones that caught regressions before users did, and the ones that didn't. β€’ Familiarity with safety considerations for LLM applications: guardrails, adversarial testing, and the failure modes that tend to introduce themselves at 4pm on a Friday. β€’ Practical understanding of HIPAA, BAAs, PHI handling, and the everyday realities of working in a regulated environment without losing the will to live. β€’ Strong written communication: design docs, technical RFCs, and documentation that someone else can actually follow six months later.

πŸ–οΈ Benefits

β€’ Excellent health and wellness benefits, fully covered by Atria, effective date of hire β€’ OneMedical membership for employees & dependents, giving access to 24/7 virtual care β€’ Fertility & family planning β€’ Company-covered preventive health screenings through partner hospitals (calcium score) β€’ Fitness Perks, including Wellhub + β€’ 401k contributions and 4% match starting after 6 months β€’ Flexible Time Off β€’ Continuing medical education (CME) and CEU support for professional licensure

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ June 18

Grafana Labs

501 - 1000

🏒 Enterprise

☁️ SaaS

πŸ€– Artificial Intelligence

Staff AI Engineer building multi-agent infrastructure and backend integrations for Grafana Labs’ observability platform. Automating Marketing Operations with LLMs, cloud services, and workflow systems.

πŸ•’ June 18

Las Vegas Sands Corp.

10,000+ employees

πŸ’Ό Consulting

πŸ“¦ Logistics

✈️ Travel

Senior Software Engineer focusing on design and orchestration of AI-driven software applications for Las Vegas Sands Corp. Leading AI workflows and maintaining code quality across development cycles.

πŸ•’ June 17

Kobie

201 - 500

πŸ’Ό Consulting

🏨 Hospitality

πŸ“¦ Logistics

AI Engineer building Python-based LLM agents and reliability systems. Developing Snowflake-integrated tools for Kobie’s enterprise loyalty programs.

πŸ•’ June 17

Synack, Inc.

201 - 500

πŸ”’ Cybersecurity

πŸ“‹ Compliance

☁️ SaaS

Senior Software Engineer leading AI-focused software development at Synack's cybersecurity platform. Designing scalable systems and mentoring junior engineers in cutting-edge technologies.

πŸ•’ June 17

Campbell's

10,000+ employees

🏭 Manufacturing

πŸ›’ Retail

🍽️ Food & Beverage

Agentic AI Engineer designing and deploying autonomous AI systems at a food industry leader. Focused on intelligent agents and AI workflows for enhanced business solutions.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok