Data Engineer, Databricks

🕒 September 1

🇺🇸 United States – Remote

💵 $123k - $160k / year

⏰ Full Time

🟠 Senior

🔴 Lead

🚰 Data Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 17%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

LMI

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 1961

📦 Logistics

🏥 Healthcare

🎖️ Defense

Logistics • Healthcare • Defense

LMI is a forward-thinking company that focuses on reimagining the path from insight to outcome through innovative solutions in various sectors, including applied AI and digital health. They provide advanced analytics, engineering support, and performance optimization across defense, health, and civilian markets, with a strong commitment to enhancing mission effectiveness for government clients. With a focus on collaboration and research, LMI aims to drive positive change through its diverse capabilities and partnerships.

📋 Description

• Lead the technical design and implementation of the RevOS data architecture within Databricks and the DHA War Data Platform • Assess and remediate DHA revenue-cycle data structures, including fragmented schemas, duplicate entities, inconsistent definitions, missing relationships, weak keys, data-quality issues, and reconciliation problems • Develop a canonical revenue-cycle data model connecting patient, encounter, appointment, eligibility, authorization, provider, documentation, diagnosis, procedure, coding, charge, claim, payer, adjudication, payment, denial, AR, appeal, follow-up, and recovery entities • Design and implement Databricks Bronze-to-Silver-to-Gold architecture • Design Gold data products and analytical data marts for dashboards and visualization workloads • Develop and maintain Databricks SQL dashboards, AI/BI dashboards, and native visualizations • Build reusable semantic datasets and optimized SQL structures for RevOS KPI calculations and drill-down analysis • Optimize dashboard queries and Gold datasets for performance, refresh cadence, scalability, and concurrent users • Configure dashboard access using Unity Catalog permissions, row-level security, column-level security, PHI/PII requirements, and user roles • Profile Bronze datasets and develop source-to-target mappings • Normalize and conform data from MHS GENESIS Millennium, Abacus, and other approved sources • Build Gold products supporting revenue-cycle KPIs, coding-audit impact, charge completeness, claims readiness, denial management, payer performance, reconciliation, underpayment detection, AR aging, revenue recovery, and audit traceability • Design the Revenue Opportunity Ledger and recovery work queues • Establish entity-resolution methodologies and deterministic or probabilistic matching across source systems • Develop and maintain ODCS-based machine-readable data contracts • Implement automated quality controls and Bronze-to-Silver/Silver-to-Gold quality gates • Build reconciliation controls across billed, allowed, paid, adjusted, patient-responsibility, AR, and recovery values • Configure and manage Databricks Unity Catalog, metadata federation, lineage, tagging, ownership, and access controls • Develop scalable Delta Lake structures and optimize partitioning, clustering, SQL performance, storage, and compute usage • Develop Databricks jobs, workflows, orchestration, production monitoring, alerting, and error handling • Version-control code and infrastructure using Government-furnished GitLab; support CI/CD and controlled production promotion • Partner with Data Scientists, Analytics Engineers, Revenue Cycle SMEs, and Coding SMEs • Develop source-to-target documentation, data dictionaries, lineage artifacts, architecture diagrams, runbooks, and sustainment documentation • Mentor Data Engineers and establish reusable Databricks engineering and visualization patterns

🎯 Requirements

• Active SECRET Clearance • Bachelor's Degree and 10+ years of experience in enterprise data engineering, data architecture, data platform development, or related disciplines • Senior/SME-level hands-on experience with Databricks • Demonstrated experience using Databricks visualization and dashboard capabilities, including Databricks SQL and/or AI/BI dashboards • Ability to design underlying Gold/semantic data structures for enterprise-scale dashboards and operational reporting • Experience creating and optimizing SQL queries, datasets, and views supporting interactive visualization and drill-down • Strong experience with Apache Spark / PySpark, SQL, Python, Delta Lake, ETL / ELT, data pipeline orchestration, and large-scale data transformation • Demonstrated experience implementing Bronze / Silver / Gold medallion architectures • Strong experience designing normalized and analytical data models for complex enterprise environments • Experience evaluating and redesigning or remediating poorly structured existing data environments • Experience designing canonical data models, conformed dimensions, enterprise keys, entity resolution, and reusable semantic structures • Strong knowledge of data-quality engineering, financial reconciliation, metadata, lineage, and data governance • Experience with Databricks Unity Catalog or equivalent enterprise data-governance/catalog technology • Experience building production-grade pipelines with automated testing, monitoring, logging, failure handling, and CI/CD • Ability to translate operational workflows into logical and physical data architectures and visualization-ready products • Experience supporting highly regulated, healthcare, financial, or Government environments • Ability to work with PHI, PII, CUI, and other controlled data under applicable security and privacy requirements • Ability to work across engineering, analytics, visualization, cybersecurity, product, architecture, and business-SME teams • Ability to meet applicable DHA/DoD security, privacy, access, and data-handling requirements