Geisinger
10,000+ employees
Founded 1915
💊 Pharmaceuticals
🧘 Wellness
Healthcare • Pharmaceuticals • Wellness
Geisinger is a healthcare organization that has been providing accessible medical services for over a century in Pennsylvania. It focuses on meeting the healthcare needs of its communities and is dedicated to innovative patient care. With career opportunities in various fields including nursing, allied health, and administration, Geisinger promotes professional development and a supportive workplace for its employees, emphasizing diversity, equity, and inclusion.
Tech Lead Data Scientist, AI Evaluation – Monitoring
🕒 April 30
📊 Check your resume score for this job
Improve your chances of getting an interview by checking your resume score before you apply.
Geisinger
10,000+ employees
Founded 1915
💊 Pharmaceuticals
🧘 Wellness
Healthcare • Pharmaceuticals • Wellness
Geisinger is a healthcare organization that has been providing accessible medical services for over a century in Pennsylvania. It focuses on meeting the healthcare needs of its communities and is dedicated to innovative patient care. With career opportunities in various fields including nursing, allied health, and administration, Geisinger promotes professional development and a supportive workplace for its employees, emphasizing diversity, equity, and inclusion.
📋 Description
• Principal technical expert for how Geisinger evaluates, monitors, and optimizes AI systems • Set technical direction for AI evaluation across a growing portfolio • Provide technical leadership to a team of data analysts • Partner with AI program teams to improve validation and monitoring methods • Design validation studies and monitoring plans for AI systems • Instrument production monitoring and define measurable metrics • Mentor analysts on methodology and technical rigor
🎯 Requirements
• 6+ years in data science, statistics, ML engineering, or applied quantitative research • Strong foundation in experimental design and causal inference • Hands-on experience designing and running model evaluation studies in real production settings • Experience evaluating LLM or generative AI systems • Proven ability to translate ambiguous failure modes into concrete evaluation designs • Strong fluency in Python and SQL • Experience with fairness and equity evaluation for ML systems • MS or PhD in a quantitative field preferred
🏖️ Benefits
• Healthcare benefits from day one • Vision insurance • Dental insurance • Domestic partner benefits • Collaboration and cooperation atmosphere
Apply NowSimilar Jobs
🕒 April 29
Senior Data Scientist building ML models for Inspiren's systems in a remote setting. Collaborating across teams to turn analyses into durable workflows that enhance product performance.
🇺🇸 United States – Remote
💵 $170k - $200k / year
💰 $2.7M Venture Round on 2022-10
⏰ Full Time
🟠 Senior
📊 Data Scientist
🕒 April 29
Group Product Manager leading Data Science and Machine Learning strategies at DICK'S Sporting Goods. Collaborating across various domains to enhance eCommerce and athlete experience.
🕒 April 29
Senior Data Scientist at Socure transforming raw datasets into actionable insights to prevent fraud. Leading innovative approaches such as agentic AI and data automation for improved decision systems.
🇺🇸 United States – Remote
💵 $170k - $200k / year
💰 $450M Series E on 2021-11
⏰ Full Time
🟠 Senior
📊 Data Scientist
🦅 H1B Visa Sponsor
🕒 April 29
Senior Data Scientist at Virta Health shaping data-driven decisions to combat metabolic disease. Collaborating across teams to identify strategic opportunities and drive impactful insights.
🇺🇸 United States – Remote
💵 $167.2k - $216k / year
⏰ Full Time
🟠 Senior
📊 Data Scientist
🦅 H1B Visa Sponsor
🕒 April 27
Data Scientist improving LLM-powered systems and security products at HiddenLayer. Building, shipping, and enhancing core models within a focused team for effective security solutions.
