Senior Databricks Engineer – Platform, Data Engineering

🕒 6 days ago

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Geisinger

Geisinger

10,000+ employees

Founded 1915

💊 Pharmaceuticals

🧘 Wellness

Healthcare • Pharmaceuticals • Wellness

Geisinger is a healthcare organization that has been providing accessible medical services for over a century in Pennsylvania. It focuses on meeting the healthcare needs of its communities and is dedicated to innovative patient care. With career opportunities in various fields including nursing, allied health, and administration, Geisinger promotes professional development and a supportive workplace for its employees, emphasizing diversity, equity, and inclusion.

📋 Description

• Manage workspaces, clusters, jobs, security configurations, libraries, and overall platform health. • Build and optimize data pipelines and transformations using PySpark and T‑SQL . • Create automation and tooling using Python , Bash , and PowerShell . • Implement and automate data governance, access controls, auditability, and compliance best practices. • Translate conversational ideas into clear solution architectures; break work into tasks in Planner or Azure DevOps for team execution. • Estimate level of effort and forecast delivery dates with reasonable accuracy. • Produce high-quality documentation including workflows, gap analyses, design specs, build docs, test plans, and transition documentation. • Oversee unit, scenario-based, integrated, capacity, and parallel testing. • Participate in a 24×7×365 on-call rotation to support Databricks , SQL Server , and other relevant applications supported by the team. • Support system upgrades, patches, performance tuning, observability, and proactive monitoring. • Maintain accountability for data integrity across applications and pipelines. • Complete system build and documentation in adherence to departmental guidelines and change management policy. • Review teammates’ work and provide constructive feedback. • Communicate effectively with peers, stakeholders, and leadership; provide regular status updates and escalate issues appropriately. • Drive discussions, mentor accountable leaders, and coordinate resources across initiatives. • Provide feedback on training materials; conduct training sessions; develop and mentor other team member.

🎯 Requirements

• Solid experience with Databricks administration , including workspace management, cluster configuration, security, jobs, and libraries. • Strong proficiency in Python and scripting with Bash and PowerShell . • Experience with PySpark and/or T‑SQL for data processing and transformation. • Excellent communication skills with the ability to articulate technical concepts clearly to varied audiences. • Demonstrated critical thinking , problem-solving , and troubleshooting skills. • Ability to estimate effort and deliver on time . • Strong understanding of data governance principles and best practices. • Commitment to information security best practices.

🏖️ Benefits

• healthcare benefits for full time and part time positions from day one • vision insurance • dental insurance • domestic partner benefits

Apply Now

Similar Jobs

🕒 6 days ago

BlueCross BlueShield of Tennessee

5001 - 10000

⚕️ Healthcare Insurance

Senior Data Engineer at BlueCross BlueShield of Tennessee leading data engineering team efforts. Responsible for building regulated data pipelines and enabling analytics for quality reporting.

Azure

Python

SQL

🕒 May 27

NBCUniversal

10,000+ employees

📱 Media

Principal Cloud Data Architect at Comcast Advertising guiding data solutions and collaborating with engineering teams. Focusing on scalability, reliability, and security in cloud offerings.

Amazon Redshift

AWS

Azure

BigQuery

Cloud

Google Cloud Platform

GraphQL

Tableau

Terraform

🕒 May 27

Defense Unicorns

51 - 200

🔒 Cybersecurity

Data Engineer designing data workflows and pipelines for Defense Unicorns. Implementing best practices in ETL/ELT, systems engineering, and data streaming technologies.

🇺🇸 United States – Remote

💵 $124.3k - $166.8k / year

💰 Seed Round on 2022-10

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

AWS

Cloud

Cyber Security

Docker

ETL

Kafka

Kubernetes

Terraform

🕒 May 27

Magna Legal Services

501 - 1000

🤝 B2B

📚 Education

Data Engineer at Magna Legal Services shaping secure data platform for analytics and AI. Leading team in Snowflake architecture and data pipelines.

🇺🇸 United States – Remote

💵 $130k - $150k / year

💰 Debt financing on 2020-02

⏰ Full Time

🟠 Senior

🚰 Data Engineer

Azure

ETL

Python

SQL

🕒 May 27

Flex

11 - 50

💳 Fintech

☁️ SaaS

🤝 B2B

Data Engineer at Flex designing and operating machine-learning systems for HSA/FSA eligibility. Collaborating across teams to build data solutions that drive decision-making at checkout.

Amazon Redshift

BigQuery

Cloud

Python

PyTorch

SQL