Senior Business Intelligence Analyst – AI Evaluation, Monitoring

πŸ•’ May 6

Where this job comes from

Posted on Geisinger's careers page β†—Geisinger's careers page, not through a job board

First seen by Remote Rocketship May 6

Still open on Geisinger's site. Checked 5 hours ago.

Apply Now
Logo of Geisinger

Geisinger

10,000+ employees

Founded 1915

πŸ₯ Healthcare

πŸ’Š Pharmaceuticals

🧘 Wellness

Healthcare β€’ Pharmaceuticals β€’ Wellness

Geisinger is a healthcare organization that has been providing accessible medical services for over a century in Pennsylvania. It focuses on meeting the healthcare needs of its communities and is dedicated to innovative patient care. With career opportunities in various fields including nursing, allied health, and administration, Geisinger promotes professional development and a supportive workplace for its employees, emphasizing diversity, equity, and inclusion.

πŸ“‹ Description

β€’ Serve as a partner to the business or clinical area supported (AI Evaluation & Monitoring) β€’ Use analytic expertise to make data-driven decisions β€’ Collect, clean, and interpret data sets to solve problems β€’ Identify and communicate improvement opportunities β€’ Support evaluation of existing AI/ML projects β€’ Mentor junior BI developers through feedback and training β€’ Independently consult with stakeholders on evaluation and data requirements β€’ Execute the evaluation work for Geisinger's AI portfolio β€’ Collaborate in the design and development of reporting solutions β€’ Recommend analysis approach based on business questions β€’ Develop, validate, and execute complex queries and reports β€’ Present analysis and reports to internal customers β€’ Troubleshoot data quality issues when profiling, testing, or validating

🎯 Requirements

β€’ Minimum 8 years of relevant experience β€’ Healthcare, clinical, or regulated-industry data experience strongly preferred β€’ Applied statistics: hypothesis testing, confidence intervals, power and sample size, regression, and non-parametric methods β€’ SQL with large, messy clinical data warehouses, including window functions, CTEs, debugging query plans, and performance tuning β€’ Python for analysis: pandas, numpy, scikit-learn, statsmodels, common evaluation libraries β€’ Production monitoring design and execution: drift detection, performance decay tracking, adoption and outcome metrics β€’ LLM and generative AI evaluation execution: golden sets, judge-based scoring, hallucination and grounding checks β€’ High School Diploma or Equivalent (GED) - Required

πŸ–οΈ Benefits

β€’ Healthcare benefits from day one, including vision and dental β€’ Atmosphere of collaboration, cooperation, and collegiality

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ May 1

insightsoftware

1001 - 5000

☁️ SaaS

πŸ’Έ Finance

🏒 Enterprise

Lead Engineer in Reporting/BI Engineering at insightsoftware, overseeing technical leadership and team delivery for BI capabilities. Engaging with clients and driving AI-first engineering practices.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $124k - $156k / year

πŸ’° $798.6M Private Equity Round - insightsoftware on 2021-07

⏰ Full Time

🟠 Senior

πŸ”΄ Lead

πŸ“Š Business Intelligence Developer

πŸ•’ April 22

Hudson Valley Systems

11 - 50

πŸ’Ό Consulting

🏒 Enterprise

🀝 B2B

BI Developer transforming data into insights through dashboards and data models for Hudson Valley Systems. Collaborating with stakeholders and ensuring data quality on multiple platforms.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok