Lead Data Engineer

🔥 14 hours ago

🇺🇸 United States – Remote

💵 $170k - $240k / year

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Astrana Health

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

💼 Consulting

📦 Logistics

🏥 Healthcare

Consulting • Logistics • Healthcare

Astrana Health is a healthcare company that operates community-focused clinics and a provider-facing technology platform to coordinate care across primary, urgent, and multi-specialty services. It supports providers and local communities by streamlining access to care, automating prior authorizations, and connecting patients with in-network clinicians. Astrana combines clinical services with doctor-built technology to improve patient experience and provider workflows.

📋 Description

• Lead the design, development, and delivery of core platform components, including the Constellation Lakehouse in Databricks, Connect API (GraphQL) layer, and Lakebase-backed applications • Build and maintain scalable batch and incremental data pipelines using Databricks, Apache Spark, PySpark, SQL, and Delta Lake • Integrate data from transactional databases, APIs, files, and external partners into governed datasets • Design and maintain unified healthcare data models spanning membership, providers, claims, encounters, clinical data, and other business domains • Develop ingestion and transformation processes including change data capture, schema evolution, deduplication, historical tracking, and reconciliation • Build and optimize data access layers and APIs with software engineering teams • Develop and support Lakebase-backed applications and PostgreSQL data structures • Maintain and optimize Databricks workspaces, compute resources, job orchestration, and environment configurations • Implement data governance and access controls through Unity Catalog • Establish automated data quality checks, reconciliation, freshness monitoring, and alerting • Apply DevOps practices including Git, automated testing, CI/CD, infrastructure as code, and repeatable deployments • Tune pipelines, Spark workloads, SQL queries, and compute configurations for performance, scalability, and cost efficiency • Investigate and resolve platform incidents and pipeline failures; perform root-cause analysis • Partner on backup, recovery, and business continuity procedures; maintain documentation and runbooks • Conduct code and design reviews, establish engineering standards, and mentor engineers

🎯 Requirements

• Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field • 5+ years of data engineering experience building and supporting enterprise data platforms and pipelines • 3+ years of hands-on experience with Databricks in production environments • Strong proficiency in Python, PySpark, SQL, and Apache Spark • Experience with Delta Lake and modern lakehouse architectures • Hands-on experience with Azure data services and cloud-based data platforms • Strong knowledge of data modeling, relational databases, and ETL/ELT best practices • Experience integrating enterprise databases and APIs into scalable data solutions • Experience with Git, CI/CD pipelines, and automated deployment practices • Proven ability to monitor, troubleshoot, and optimize data pipelines and platform performance • Demonstrated leadership in solution design, code reviews, mentoring, and cross-functional collaboration • Strong problem-solving and communication skills • Preferred: Experience administering and optimizing Databricks environments, including Unity Catalog • Preferred: Experience with PostgreSQL, GraphQL APIs, and operational applications leveraging lakehouse data • Preferred: Healthcare data experience, including claims, eligibility, provider, or clinical datasets • Preferred: Familiarity with HL7, FHIR, and X12 • Preferred: Experience with Terraform or other infrastructure-as-code tools • Preferred: Experience with streaming data pipelines and event-driven architectures • Preferred: Experience supporting AI, machine learning, or NLP data workloads • Preferred: Familiarity with regulated data environments and governance best practices • Preferred: Experience with cloud data platform migrations and modernization initiatives • Preferred: Azure, Databricks, or AWS certifications

🏖️ Benefits

• Remote position based in the U.S. • Equal Employment Opportunity and Affirmative Action employer • Disability accommodation support during application