Tech Lead Data Scientist, AI Evaluation – Monitoring

Job not on LinkedIn

πŸ•’ April 30

Where this job comes from

Posted on Geisinger's careers page β†—Geisinger's careers page, not through a job board

First seen by Remote Rocketship April 30

Still open on Geisinger's site. Checked 6 hours ago.

Apply Now
Logo of Geisinger

Geisinger

10,000+ employees

Founded 1915

πŸ₯ Healthcare

πŸ’Š Pharmaceuticals

🧘 Wellness

Healthcare β€’ Pharmaceuticals β€’ Wellness

Geisinger is a healthcare organization that has been providing accessible medical services for over a century in Pennsylvania. It focuses on meeting the healthcare needs of its communities and is dedicated to innovative patient care. With career opportunities in various fields including nursing, allied health, and administration, Geisinger promotes professional development and a supportive workplace for its employees, emphasizing diversity, equity, and inclusion.

πŸ“‹ Description

β€’ Principal technical expert for how Geisinger evaluates, monitors, and optimizes AI systems β€’ Set technical direction for AI evaluation across a growing portfolio β€’ Provide technical leadership to a team of data analysts β€’ Partner with AI program teams to improve validation and monitoring methods β€’ Design validation studies and monitoring plans for AI systems β€’ Instrument production monitoring and define measurable metrics β€’ Mentor analysts on methodology and technical rigor

🎯 Requirements

β€’ 6+ years in data science, statistics, ML engineering, or applied quantitative research β€’ Strong foundation in experimental design and causal inference β€’ Hands-on experience designing and running model evaluation studies in real production settings β€’ Experience evaluating LLM or generative AI systems β€’ Proven ability to translate ambiguous failure modes into concrete evaluation designs β€’ Strong fluency in Python and SQL β€’ Experience with fairness and equity evaluation for ML systems β€’ MS or PhD in a quantitative field preferred

πŸ–οΈ Benefits

β€’ Healthcare benefits from day one β€’ Vision insurance β€’ Dental insurance β€’ Domestic partner benefits β€’ Collaboration and cooperation atmosphere

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ April 23

NXT LABS

51 - 200

🀝 B2B

πŸ€– Artificial Intelligence

🏒 Enterprise

Lead Data Scientist at NXT LABS overseeing Data Science projects with business impact. Building predictive models and collaborating with teams on data-driven decisions.

πŸ•’ April 22

Tiger Analytics

1001 - 5000

πŸ₯ Healthcare

πŸ“¦ Logistics

πŸ“£ Marketing

Lead Data Scientist at Tiger Analytics driving advanced analytics initiatives focused on healthcare. Collaborating with stakeholders and optimizing AI solutions for business outcomes.

πŸ•’ April 22

Junction

11 - 50

πŸ“š Education

🀝 Non-profit

Data Scientist leading modeling, experimentation, and evaluation for Junction’s diagnostic healthcare infrastructure. Turning clinical and patient data into reliable product and business decisions.

πŸ•’ April 21

Kard

51 - 200

πŸ’Ό Consulting

πŸ“£ Marketing

πŸ“¦ Logistics

Senior Data Scientist building production ML models for Kard’s card-linked offers and commerce media infrastructure. Improving personalization, ranking, experimentation, and partner ROI measurement.

πŸ•’ April 20

Airbnb

5001 - 10000

✈️ Travel

πŸ“¦ Logistics

πŸ›οΈ eCommerce

Senior Staff Data Scientist at Airbnb focusing on marketplace AI and guest experience optimization through data and collaboration with product teams.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok