Senior Databricks Engineer – Platform, Data Engineering

🕒 il y a 2 mois

🔔 Pennsylvania – Distant

info

⏰ Temps Plein

🟠 Senior

🚰 Ingénieur Data

🦅 Parrain de Visa H1B

info

🗣️🇺🇸🇬🇧 Anglais requis

Postuler Maintenant
Trouver des Emplois à Distance Similaires

📊 Vérifiez votre score de CV pour ce poste

Améliorez vos chances d'obtenir un entretien en vérifiant votre score de CV avant de postuler.

Logo of Geisinger

Geisinger

10 000+ employés

Fondée en 1915

🏥 Santé

💊 Pharmaceutique

🧘 Bien-être

Healthcare • Pharmaceuticals • Wellness

Geisinger est une organisation de santé qui dessert les communautés de Pennsylvanie depuis plus d'un siècle, fournissant des services médicaux essentiels et des solutions de santé innovantes. L'organisation met l'accent sur la diversité, le développement de carrière et la création d'un environnement de soutien pour ses employés, tout en s'efforçant d'améliorer la santé et le bien-être de ses patients grâce à divers programmes et initiatives communautaires. Geisinger est reconnu comme l'un des systèmes de santé les plus innovants, et s'engage à façonner l'avenir de la santé en se concentrant sur les soins aux patients et l'inclusivité.

Description

• Manage workspaces, clusters, jobs, security configurations, libraries, and overall platform health. • Build and optimize data pipelines and transformations using PySpark and T‑SQL . • Create automation and tooling using Python , Bash , and PowerShell . • Implement and automate data governance, access controls, auditability, and compliance best practices. • Translate conversational ideas into clear solution architectures; break work into tasks in Planner or Azure DevOps for team execution. • Estimate level of effort and forecast delivery dates with reasonable accuracy. • Produce high-quality documentation including workflows, gap analyses, design specs, build docs, test plans, and transition documentation. • Oversee unit, scenario-based, integrated, capacity, and parallel testing. • Participate in a 24×7×365 on-call rotation to support Databricks , SQL Server , and other relevant applications supported by the team. • Support system upgrades, patches, performance tuning, observability, and proactive monitoring. • Maintain accountability for data integrity across applications and pipelines. • Complete system build and documentation in adherence to departmental guidelines and change management policy. • Review teammates’ work and provide constructive feedback. • Communicate effectively with peers, stakeholders, and leadership; provide regular status updates and escalate issues appropriately. • Drive discussions, mentor accountable leaders, and coordinate resources across initiatives. • Provide feedback on training materials; conduct training sessions; develop and mentor other team member.

🎯 Exigences

• Solid experience with Databricks administration , including workspace management, cluster configuration, security, jobs, and libraries. • Strong proficiency in Python and scripting with Bash and PowerShell . • Experience with PySpark and/or T‑SQL for data processing and transformation. • Excellent communication skills with the ability to articulate technical concepts clearly to varied audiences. • Demonstrated critical thinking , problem-solving , and troubleshooting skills. • Ability to estimate effort and deliver on time . • Strong understanding of data governance principles and best practices. • Commitment to information security best practices.

🏖️ Avantages

• healthcare benefits for full time and part time positions from day one • vision insurance • dental insurance • domestic partner benefits

Postuler Maintenant

Emplois Similaires

🕒 il y a 2 mois

Defense Unicorns

51 - 200

💼 Conseil

📦 Logistique

🎖️ Défense

Data Engineer designing data workflows and pipelines for Defense Unicorns. Implementing best practices in ETL/ELT, systems engineering, and data streaming technologies.

🇺🇸 États-Unis – Télétravail

💵 $124 250 - $166 750 / an

💰 Seed Round en 2022-10

⏰ Temps Plein

🟡 Intermédiaire

🟠 Senior

🚰 Ingénieur Data

🗣️🇺🇸🇬🇧 Anglais requis

🕒 il y a 2 mois

Magna Legal Services

501 - 1000

💼 Conseil

🛡️ Assurance

📦 Logistique

Data Engineer at Magna Legal Services shaping secure data platform for analytics and AI. Leading team in Snowflake architecture and data pipelines.

🇺🇸 États-Unis – Télétravail

💵 $130 000 - $150 000 / an

💰 Debt financing en 2020-02

⏰ Temps Plein

🟠 Senior

🚰 Ingénieur Data

🗣️🇺🇸🇬🇧 Anglais requis

🕒 il y a 2 mois

Lyra Health

501 - 1000

🏥 Santé

⚕️ Assurance santé

☁️ SaaS

Sr. Data Engineer developing and scaling data infrastructure for mental health care at Lyra Health. Building data systems to empower teams' decisions and improve patient outcomes.

🇺🇸 États-Unis – Télétravail

💵 $128 000 - $176 000 / an

💰 €235 000 000 Series F en 2022-01

⏰ Temps Plein

🟠 Senior

🚰 Ingénieur Data

🦅 Parrain de Visa H1B

info

🗣️🇺🇸🇬🇧 Anglais requis

Airflow

Apache

Cloud

Python

SQL

Tableau

🕒 il y a 2 mois

Order.co

51 - 200

☁️ SaaS

💳 Fintech

🤝 B2B

Senior AI/Data Engineer designing and maintaining data and AI infrastructure for Order.co's innovative B2B commerce solutions. Collaborating with cross-functional teams to enable intelligent decision-making.

🇺🇸 États-Unis – Télétravail

💵 $175 000 - $200 000 / an

💰 €30 000 000 Series B - Order en 2022-01

⏰ Temps Plein

🟠 Senior

🚰 Ingénieur Data

🗣️🇺🇸🇬🇧 Anglais requis

🕒 il y a 2 mois

Softgic

51 - 200

💼 Conseil

🤝 B2B

🤖 Intelligence artificielle

Senior Data Engineer at Softgic focusing on scalable data systems and supporting analytics initiatives. Collaborating across teams to maintain ETL/ELT data pipelines.

🇺🇸 États-Unis – Télétravail

⏰ Temps Plein

🟠 Senior

🚰 Ingénieur Data

🗣️🇺🇸🇬🇧 Anglais requis

Airflow

Amazon Redshift

AWS

EC2

ETL

MongoDB

Postgres

Python