Principal Data Platform Engineer, Databricks

Job not on LinkedIn

🕒 May 29

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Prominence Advisors

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2014

⚕️ Healthcare Insurance

🤖 Artificial Intelligence

🏢 Enterprise

Healthcare Insurance • Artificial Intelligence • Enterprise

Prominence Advisors is a data enablement company that has been empowering health systems across the United States with self-service analytics since 2011. They integrate data from multiple sources in real-time, enabling large healthcare providers to maximize the value of their data. Prominence helps healthcare organizations leverage their data to make healthcare smarter, improve patient outcomes, reduce the cost of care, and increase operational efficiencies. Their solutions have saved clients millions of dollars and empowered healthcare leaders by building trust in their data through governed self-service analytics.

📋 Description

• Own the end-to-end architecture and delivery of scalable data solutions, with a strong emphasis on Databricks-based platforms and modern cloud ecosystems • Lead design and implementation of data pipelines, data models, and transformation frameworks that support analytics, reporting, and advanced use cases • Serve as a primary client-facing technical leader, building trusted relationships and guiding stakeholders through complex data challenges and solution decisions • Translate ambiguous business requirements into clear, actionable technical architectures and delivery plans • Establish and enforce best practices across data engineering, including data ingestion (pipeline orchestration, testing, and optimization) and DevOps • Drive platform strategy and architecture decisions, including lakehouse design, medallion architecture, and governance frameworks • Lead and mentor delivery teams, providing technical guidance, code reviews, and hands-on support to ensure successful project outcomes • Collaborate with cross-functional teams including data architects, analysts, and client stakeholders to ensure alignment and value delivery • Identify risks, proactively address challenges, and ensure high-quality, timely delivery across engagements • Contribute to internal capability building, including reusable frameworks, accelerators, and thought leadership • Support business development efforts by shaping technical solutions, contributing to proposals, and participating in client discussions

🎯 Requirements

• 7+ years of experience in data engineering, with demonstrated progression into technical leadership and architecture ownership • Deep expertise in Databricks and modern lakehouse architectures, including Delta Lake and Spark-based processing • Advanced proficiency in SQL and Python, with strong experience building and optimizing large-scale data pipelines • Hands-on experience with cloud platforms such as AWS, Azure, or GCP, including data services and infrastructure design • Strong understanding of data modeling concepts, ETL/ELT patterns, and distributed data processing • Experience with orchestration tools (e.g., Airflow) and transformation frameworks (e.g., dbt) • Proven ability to lead technical delivery while remaining hands-on when needed • Strong client-facing experience, including requirements gathering, solution design, and executive communication • Ability to navigate ambiguity, prioritize effectively, and drive clarity in complex environments • Healthcare data experience (e.g., Epic, HL7, FHIR, claims data) is strongly preferred • Experience with CI/CD, DevOps practices, and infrastructure-as-code tools is a plus

🏖️ Benefits

• Competitive Salaried and Hybrid Compensation Plans • Health Care Plan (Medical, HSAs, Dental & Vision) • Retirement Plan (401k) • Life Insurance (Basic, Voluntary & AD&D) • Dependent & Health Savings Accounts • Short Term & Long Term Disability • Paid Time Off (Vacation/Sick & Public Holidays) • Training & Development Fund • Work From Home • Charitable Giving to Causes You Believe In