Data Engineer – Databricks, Lakehouse, Power BI

🕒 June 5

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Hillenbrand

Hillenbrand

5001 - 10000 employees

Manufacturing • Engineering • Sustainability

Hillenbrand is a global provider of highly engineered, mission-critical processing equipment and systems, serving a diverse range of industries including durable plastics, food, and recycling. With a commitment to innovation and sustainability, Hillenbrand focuses on shaping solutions that impact lives and drive growth in a continually changing world. The company emphasizes excellence and continuous improvement, ensuring their products not only meet present-day needs but also anticipate future demands.

📋 Description

• Design, develop, and maintain scalable data pipelines using Databricks and Delta Lake • Build and manage transformations across bronze, silver, and gold layers • Optimize processing for performance, reliability, and cost • Integrate data from ERP, CRM, APIs, and other enterprise systems • Develop gold-layer datasets aligned to standardized business definitions • Translate business requirements into reusable data models • Ensure consistency of core metrics across reporting • Align Databricks outputs with Power BI semantic models • Implement automated data quality checks and validation rules • Build testable, production-ready pipelines • Support impact analysis using lineage tools • Participate in CI/CD and deployment processes • Monitor and optimize pipeline performance • Troubleshoot issues across environments • Ensure data consistency between dev, test, and prod • Support high-volume data workloads • Use AI-assisted tools for development (e.g., Copilot, Databricks Agents) (Preferred) • Explore AI agents for testing, lineage analysis, and optimization (Preferred) • Partner with BI and business teams • Support governance and cataloging efforts • Document data models and pipelines

🎯 Requirements

• Bachelor’s degree in relevant field • 8+ years data engineering experience • Strong Databricks, Spark, Delta Lake experience • SQL and Python proficiency • Experience with Power BI or similar tools • Azure Data Factory, Synapse, or Data Lake experience (Preferred) • DevOps and CI/CD experience (Preferred) • AI agents or AI-assisted development exposure (Preferred) • Experience in large, complex enterprise environments (Preferred)

🏖️ Benefits

• Health insurance • 401(k) matching • Flexible work hours • Paid time off

Apply Now

Similar Jobs

🕒 June 4

Anteriad

201 - 500

🤝 B2B

Data Engineer at Anteriad optimizing data pipelines using Azure services. Partnering with stakeholders to create scalable data engineering solutions.

AWS

Azure

Cloud

ETL

Google Cloud Platform

MS SQL Server

PySpark

Python

Spark

SQL

SSIS

Vault

🕒 June 3

Everest Technologies, Inc

51 - 200

🤝 B2B

☁️ SaaS

Senior Data Engineer at ETech designing data pipelines for AI context and knowledge systems. Focus on implementing Vector Databases and managing data governance for AI.

BigQuery

Cloud

NoSQL

Pandas

PySpark

Python

SQL

.NET

🕒 May 30

Miratech

501 - 1000

Senior Technical Project Manager driving large-scale data platform migration projects for global clients at Miratech. Overseeing delivery lifecycle, ensuring technical excellence and stakeholder satisfaction.

Airflow

Cloud

🕒 May 29

Miratech

501 - 1000

Senior Technical Project Manager leading complex data platform migration initiatives for clients at Miratech. Overseeing project delivery lifecycle while ensuring customer satisfaction and technical excellence.

Airflow

Cloud

🕒 May 27

Capgemini

10,000+ employees

🏢 Enterprise

🤖 Artificial Intelligence

🔒 Cybersecurity

Data Engineer responsible for architecting and maintaining scalable data pipelines in a medallion architecture. Join a leading insurer transforming data engineering processes.

Apache

AWS

Cloud

ElasticSearch

Java

Jenkins

Kubernetes

Logstash

Python

Spark

Spring

Spring Boot

SpringBoot

Vault