Senior Data Engineer, Platform

🔥 13 hours ago

🇺🇸 United States – Remote

💵 $180k - $220k / year

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 5%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Vanna Health

WebsiteLinkedInAll Job Openings

1 - 10 employees

Founded 2021

💼 Consulting

📦 Logistics

📣 Marketing

Consulting • Logistics • Marketing

Vanna Health is a company dedicated to reimagining care and community for individuals with serious mental illness (SMI). They focus on psychosocial rehabilitation to improve health outcomes and reduce healthcare costs. By rebuilding payment models and technology, they enable community-based care, enhancing the quality of life for people with SMI. Vanna Health provides inclusive psychosocial rehab at scale, using their Vanna Connect program to engage individuals through methods such as 1:1 coaching, local support groups, and digital engagement. Their approach not only reduces healthcare costs but also fosters community inclusion and social outcome improvements.

📋 Description

• Own the infrastructure and platform supporting data jobs, including compute choices, orchestration, deployment, connectivity, reliability, and observability • Set technical direction, make architecture decisions, write design documentation, and make build-versus-buy decisions • Shape the data platform roadmap, own delivery, and communicate progress, risks, and trade-offs • Establish design and code-review standards, mentor engineers, and unblock platform contributors • Own Databricks and AWS platform architecture, including ingestion, storage, compute, access control, and environments • Build tested, versioned connections to payer claims, eligibility, attribution, clinical, event, and care-platform systems over SFTP, S3, private networking, FHIR, and HL7 • Optimize job performance and cost through compute selection, right-sizing, serverless or cluster decisions, and migration from single-machine Python to distributed compute • Own orchestration, deployments, Terraform, GitLab CI/CD, automated tests, and release practices • Improve reliability and observability, detect failures and anomalies early, and design recoverable operations • Make governed data usable by AI through metric definitions, Genie spaces, and MCP servers • Validate incoming data using row counts, date spans, expected fields, and historical coverage • Automate recurring data operations and participate in a shared, lightweight data operations rotation • Protect PHI through access controls, auditing, de-identification, and secure data exchange • Provide analytics engineering with a reliable, timely, cost-effective platform • Represent data engineering with partners, vendors, and colleagues and share knowledge

🎯 Requirements

• Typically seven or more years building production software or data systems • Several years owning data infrastructure or pipelines end to end, from design through operation • Production experience with at least one distributed data processing engine at scale, such as Spark, Databricks, Snowflake, BigQuery, Flink, Dask, or Ray • Strong Python and defensible SQL skills • Experience designing systems on a major cloud; AWS preferred, including storage, compute, networking, IAM, and cost • Experience with automated testing, CI/CD, infrastructure as code, code review, observability, and incident response • Experience leading technical work and mentoring other engineers • Experience investigating upstream data problems through resolution • Daily use of AI coding agents and ability to identify incorrect AI results on real data • Familiarity with Databricks, Delta Lake, Unity Catalog, and dbt is a bonus • Familiarity with Databricks Genie, MCP servers, or other governed-data approaches for AI agents is a bonus • Healthcare or regulated-data experience, including claims, eligibility, FHIR, HL7 v2, HIPAA, or SOC 2, is a bonus • Experience with workflow orchestration, event-driven ingestion, or serverless compute is a bonus • Experience leading or managing engineers, or interest in growing into a data engineering lead, is a bonus • Must physically reside in the United States • Must answer whether visa sponsorship will be required to maintain employment authorization

🏖️ Benefits

• Extensive development opportunities • Diverse career paths • Culture valuing diversity, equity, inclusion, and belonging • Innovative payment models and technology-driven community health mission

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume