Geisinger
10,000+ employees
Founded 1915
🏥 Healthcare
💊 Pharmaceuticals
🧘 Wellness
Healthcare • Pharmaceuticals • Wellness
Geisinger is a healthcare organization that has been providing accessible medical services for over a century in Pennsylvania. It focuses on meeting the healthcare needs of its communities and is dedicated to innovative patient care. With career opportunities in various fields including nursing, allied health, and administration, Geisinger promotes professional development and a supportive workplace for its employees, emphasizing diversity, equity, and inclusion.
Tech Lead Data Scientist, AI Evaluation – Monitoring
🕒 April 30
📊 Check your resume score for this job
Improve your chances of getting an interview by checking your resume score before you apply.
Geisinger
10,000+ employees
Founded 1915
🏥 Healthcare
💊 Pharmaceuticals
🧘 Wellness
Healthcare • Pharmaceuticals • Wellness
Geisinger is a healthcare organization that has been providing accessible medical services for over a century in Pennsylvania. It focuses on meeting the healthcare needs of its communities and is dedicated to innovative patient care. With career opportunities in various fields including nursing, allied health, and administration, Geisinger promotes professional development and a supportive workplace for its employees, emphasizing diversity, equity, and inclusion.
📋 Description
• Principal technical expert for how Geisinger evaluates, monitors, and optimizes AI systems • Set technical direction for AI evaluation across a growing portfolio • Provide technical leadership to a team of data analysts • Partner with AI program teams to improve validation and monitoring methods • Design validation studies and monitoring plans for AI systems • Instrument production monitoring and define measurable metrics • Mentor analysts on methodology and technical rigor
🎯 Requirements
• 6+ years in data science, statistics, ML engineering, or applied quantitative research • Strong foundation in experimental design and causal inference • Hands-on experience designing and running model evaluation studies in real production settings • Experience evaluating LLM or generative AI systems • Proven ability to translate ambiguous failure modes into concrete evaluation designs • Strong fluency in Python and SQL • Experience with fairness and equity evaluation for ML systems • MS or PhD in a quantitative field preferred
🏖️ Benefits
• Healthcare benefits from day one • Vision insurance • Dental insurance • Domestic partner benefits • Collaboration and cooperation atmosphere
Apply NowSimilar Jobs
🕒 April 29
Group Product Manager leading Data Science and Machine Learning strategies at DICK'S Sporting Goods. Collaborating across various domains to enhance eCommerce and athlete experience.
🕒 April 27
Senior Data Scientist applying AI expertise in machine learning and data analytics at Tiger Analytics. Collaborating with cross-functional teams to drive business value from data.
🕒 April 26
Manager, Data Science role at Whatnot leading team to drive analytical strategy and solve marketplace challenges. Focus on growth, ecosystem health, and developing data-driven solutions.
🇺🇸 United States – Remote
💵 $221k - $320k / year
💰 $260M Series D on 2022-07
⏰ Full Time
🟠 Senior
🔴 Lead
📊 Data Scientist
🦅 H1B Visa Sponsor
🕒 April 25
Senior Data Scientist leading development of the core Claim Clustering Platform for AI-driven casual claims analysis. Collaborating with Machine Learning Engineers and Data Engineering teams to optimize solutions.
🇺🇸 United States – Remote
💵 $180k - $200k / year
⏰ Full Time
🟠 Senior
📊 Data Scientist
🦅 H1B Visa Sponsor
🕒 April 24
Driver seeks an Applied Data Scientist for LLM evaluation, building evaluation strategies from scratch. This role involves defining quality metrics and establishing automated evaluation pipelines.
