Tech Lead Data Scientist, AI Evaluation – Monitoring

Job not on LinkedIn

🕒 April 30

🔔 Pennsylvania – Remote

🔔 Pennsylvania – Remote

⏰ Full Time

🟠 Senior

📊 Data Scientist

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 45%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Geisinger

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1915

🏥 Healthcare

💊 Pharmaceuticals

🧘 Wellness

Healthcare • Pharmaceuticals • Wellness

Geisinger is a healthcare organization that has been providing accessible medical services for over a century in Pennsylvania. It focuses on meeting the healthcare needs of its communities and is dedicated to innovative patient care. With career opportunities in various fields including nursing, allied health, and administration, Geisinger promotes professional development and a supportive workplace for its employees, emphasizing diversity, equity, and inclusion.

📋 Description

• Principal technical expert for how Geisinger evaluates, monitors, and optimizes AI systems • Set technical direction for AI evaluation across a growing portfolio • Provide technical leadership to a team of data analysts • Partner with AI program teams to improve validation and monitoring methods • Design validation studies and monitoring plans for AI systems • Instrument production monitoring and define measurable metrics • Mentor analysts on methodology and technical rigor

🎯 Requirements

• 6+ years in data science, statistics, ML engineering, or applied quantitative research • Strong foundation in experimental design and causal inference • Hands-on experience designing and running model evaluation studies in real production settings • Experience evaluating LLM or generative AI systems • Proven ability to translate ambiguous failure modes into concrete evaluation designs • Strong fluency in Python and SQL • Experience with fairness and equity evaluation for ML systems • MS or PhD in a quantitative field preferred

🏖️ Benefits

• Healthcare benefits from day one • Vision insurance • Dental insurance • Domestic partner benefits • Collaboration and cooperation atmosphere