Databricks Data Engineer, SME

🔥 12 hours ago

🇺🇸 United States – Remote

💵 $123k - $160k / year

⏰ Full Time

🟠 Senior

🔴 Lead

🚰 Data Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

LMI

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 1961

📦 Logistics

🏥 Healthcare

🎖️ Defense

Logistics • Healthcare • Defense

LMI is a forward-thinking company that focuses on reimagining the path from insight to outcome through innovative solutions in various sectors, including applied AI and digital health. They provide advanced analytics, engineering support, and performance optimization across defense, health, and civilian markets, with a strong commitment to enhancing mission effectiveness for government clients. With a focus on collaboration and research, LMI aims to drive positive change through its diverse capabilities and partnerships.

📋 Description

• Lead the technical design and implementation of the RevOS data architecture within Databricks and the DHA War Data Platform • Assess and remediate existing DHA revenue-cycle data structures, including schemas, entities, definitions, relationships, keys, data quality, and reconciliation • Develop a canonical revenue-cycle data model connecting patient, encounter, authorization, provider, documentation, diagnosis, procedure, coding, charge, claim, payment, denial, accounts receivable, appeal, follow-up, and recovery entities • Design and implement Databricks Bronze → Silver → Gold architecture for RevOS • Design Gold data products and analytical data marts for dashboards and visualization workloads • Develop and maintain Databricks SQL dashboards, AI/BI dashboards, and native visualizations • Build reusable semantic datasets and optimized SQL structures for RevOS KPI calculations across enterprise, DHN, MTF, department, provider, encounter, and claim levels • Optimize dashboard queries and Gold datasets for performance, refresh cadence, scalability, and concurrent users • Configure dashboard access using Unity Catalog permissions, row-level security, column-level security, PHI/PII requirements, and user roles • Support dashboard drill-down from Healthy / At Risk / Critical indicators into record-level exceptions and work queues • Profile Bronze datasets and develop source-to-target mappings • Normalize and conform data from MHS GENESIS Millennium, Abacus, and other approved sources • Develop reusable Silver-layer entities with common keys, normalized timestamps, reference dimensions, and standardized definitions • Build Gold products supporting revenue-cycle KPIs, coding-audit impact, charge completeness, claims readiness, Days-to-Bill, denial management, payer performance, payment/remittance reconciliation, underpayment detection, AR aging, revenue recovery, and audit/NFR traceability • Design the data model supporting the Revenue Opportunity Ledger and recovery work queues • Establish entity-resolution methodologies and deterministic/probabilistic matching across source systems • Develop and maintain ODCS-based machine-readable data contracts • Implement automated quality controls and Bronze-to-Silver/Silver-to-Gold quality gates • Build reconciliation controls across billed, allowed, paid, adjusted, patient-responsibility, AR, and recovery values • Configure and manage Databricks Unity Catalog, including catalog/schema/table design, classification, tagging, ownership, lineage, security, and access controls • Support enterprise metadata federation and DHA data-governance requirements • Develop scalable Delta Lake structures and optimize partitioning, clustering, SQL performance, storage, and compute usage • Develop Databricks jobs, workflows, orchestration, production monitoring, alerting, and error handling • Version-control code, transformations, contracts, configurations, and infrastructure-as-code using Government-furnished GitLab • Support automated CI/CD and controlled production promotion • Partner with Data Scientists, Analytics Engineers, Revenue Cycle and Coding SMEs to support modeling, analytics, recovery scoring, anomaly detection, dashboards, and business rules • Develop source-to-target documentation, data dictionaries, lineage artifacts, architecture diagrams, runbooks, and sustainment documentation • Mentor Data Engineers and establish reusable Databricks engineering and visualization patterns

🎯 Requirements

• Active SECRET Clearance • Bachelor's Degree and 10+ years of experience in enterprise data engineering, data architecture, data platform development, or related disciplines • Senior/SME-level hands-on experience with Databricks • Demonstrated experience using Databricks visualization and dashboard capabilities, including Databricks SQL and/or AI/BI dashboards • Ability to design underlying Gold/semantic data structures for enterprise-scale dashboards and operational reporting • Experience creating and optimizing SQL queries, datasets, and views supporting interactive visualization and drill-down • Strong experience with Apache Spark / PySpark, SQL, Python, Delta Lake, ETL / ELT, data pipeline orchestration, and large-scale data transformation • Demonstrated experience implementing Bronze / Silver / Gold medallion architectures • Strong experience designing normalized and analytical data models for complex enterprise environments • Experience evaluating and redesigning or remediating poorly structured existing data environments • Experience designing canonical data models, conformed dimensions, enterprise keys, entity resolution, and reusable semantic structures • Strong knowledge of data-quality engineering, financial reconciliation, metadata, lineage, and data governance • Experience with Databricks Unity Catalog or equivalent enterprise data-governance/catalog technology • Experience building production-grade pipelines with automated testing, monitoring, logging, failure handling, and CI/CD • Ability to translate operational workflows into logical and physical data architectures and visualization-ready products • Experience supporting highly regulated, healthcare, financial, or Government environments • Ability to work with PHI, PII, CUI, and other controlled data under applicable security and privacy requirements • Ability to work across engineering, analytics, visualization, cybersecurity, product, architecture, and business-SME teams • Ability to meet applicable DHA/DoD security, privacy, access, and data-handling requirements • Preferred: Prior experience with Advana and/or the current War Data Platform (WDP) • Preferred: Direct experience developing Databricks data products and dashboards in a DoD enterprise environment • Preferred: Experience with DHA, MHS, or other DoD healthcare data • Preferred: Experience with MHS GENESIS / Oracle Health/Cerner Millennium and/or Abacus • Preferred: Healthcare revenue-cycle data experience • Preferred: Familiarity with healthcare EDI transactions including 837, 835, 270/271, 276/277, and 278 • Preferred: Experience implementing ODCS or comparable machine-readable contracts • Preferred: Experience with GitLab-based DevSecOps, infrastructure-as-code, automated testing, and secure promotion • Preferred: Familiarity with Collibra or comparable enterprise data catalogs • Preferred: Experience supporting financial auditability, reconciliation, lineage, and audit-remediation initiatives • Preferred: Familiarity with DoD RMF, NIST, IL4/IL5 environments, and federal data-governance requirements