Databricks Developer

Job not on LinkedIn

🔥 0 minutes ago

🐎 Kentucky – Remote

🐎 Kentucky – Remote

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🖥 Software Engineer

👻 Ghost score 25%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Delan Associates Inc.

WebsiteLinkedInAll Job Openings

51 - 200 employees

🎖️ Defense

📦 Logistics

💼 Consulting

Defense • Logistics • Consulting

Delan Associates Inc. is a professional services and engineering firm, founded in 2002, that provides training, systems engineering, facilities maintenance, acquisition support, and general management services primarily to U. S. government and military customers. The company supports multiple U. S. Army schools with instructor and training services, has provided facilities maintenance and logistics support for operations such as Afghanistan and U. S. Central Command, and offers network and systems engineering expertise including SIPR/NIPR implementations. DAI is an SBA 8(a) certified Small Disadvantaged Business and partners with established defense and government contractors.

📋 Description

• Design and implement scalable data solutions using Databricks Lakehouse Architecture • Develop and maintain data pipelines using PySpark, Python, and SQL • Build and optimize ETL/ELT workflows for batch and near real-time data processing • Implement Delta Lake features including ACID transactions, time travel, schema evolution, and data versioning • Design and maintain enterprise data models for reporting and analytics • Ensure data quality through validation, monitoring, reconciliation, and governance controls • Develop and manage data catalogs, metadata management, and data lineage processes • Collaborate with business stakeholders, architects, and analytics teams to translate requirements into technical solutions • Optimize Databricks workloads for performance, scalability, and cost efficiency • Implement security, access controls, and governance best practices within the Databricks ecosystem • Support troubleshooting, root cause analysis, and production issue resolution • Contribute to data platform modernization and cloud migration initiatives

🎯 Requirements

• Strong experience with Databricks Architecture and platform administration • Hands-on expertise in Databricks Lakehouse Architecture • Deep understanding of Delta Lake concepts and implementation • Experience with Unity Catalog / Data Catalog and metadata management • Knowledge of Databricks Workflows, Jobs, Clusters, and Performance Tuning • Strong proficiency in PySpark for large-scale data processing • Advanced Python programming skills • Expert-level SQL development and query optimization • Experience building robust ETL/ELT pipelines • Strong understanding of data modeling techniques including Star Schema, Snowflake Schema, Dimensional Modeling, and Data Vault (preferred) • Experience implementing data quality frameworks and validation checks • Knowledge of data lineage, metadata management, and governance processes • Experience with data reconciliation, profiling, and monitoring tools • Preferred experience with Azure Databricks, Azure Data Lake Storage (ADLS), Azure Data Factory, Azure Synapse Analytics, and CI/CD pipelines (Azure DevOps, GitHub Actions) • Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or a related field • 4-8 years of experience in Data Engineering and Analytics • Minimum 3+ years of hands-on experience with Databricks and PySpark • Experience working in Agile development environments