Data Engineer – Databricks, Lakehouse, Power BI

🔥 0 minutes ago

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Hillenbrand

Hillenbrand

5001 - 10000 employees

Manufacturing • Engineering • Sustainability

Hillenbrand is a global provider of highly engineered, mission-critical processing equipment and systems, serving a diverse range of industries including durable plastics, food, and recycling. With a commitment to innovation and sustainability, Hillenbrand focuses on shaping solutions that impact lives and drive growth in a continually changing world. The company emphasizes excellence and continuous improvement, ensuring their products not only meet present-day needs but also anticipate future demands.

📋 Description

• Design, develop, and maintain scalable data pipelines using Databricks and Delta Lake • Build and manage transformations across bronze, silver, and gold layers • Optimize processing for performance, reliability, and cost • Integrate data from ERP, CRM, APIs, and other enterprise systems • Develop gold-layer datasets aligned to standardized business definitions • Translate business requirements into reusable data models • Ensure consistency of core metrics across reporting • Align Databricks outputs with Power BI semantic models • Implement automated data quality checks and validation rules • Build testable, production-ready pipelines • Support impact analysis using lineage tools • Participate in CI/CD and deployment processes • Monitor and optimize pipeline performance • Troubleshoot issues across environments • Ensure data consistency between dev, test, and prod • Support high-volume data workloads • Use AI-assisted tools for development (e.g., Copilot, Databricks Agents) (Preferred) • Explore AI agents for testing, lineage analysis, and optimization (Preferred) • Partner with BI and business teams • Support governance and cataloging efforts • Document data models and pipelines

🎯 Requirements

• Bachelor’s degree in relevant field • 8+ years data engineering experience • Strong Databricks, Spark, Delta Lake experience • SQL and Python proficiency • Experience with Power BI or similar tools • Azure Data Factory, Synapse, or Data Lake experience (Preferred) • DevOps and CI/CD experience (Preferred) • AI agents or AI-assisted development exposure (Preferred) • Experience in large, complex enterprise environments (Preferred)

🏖️ Benefits

• Health insurance • 401(k) matching • Flexible work hours • Paid time off

Apply Now

Similar Jobs

🔥 15 hours ago

Anteriad

201 - 500

🤝 B2B

Data Engineer at Anteriad optimizing data pipelines using Azure services. Partnering with stakeholders to create scalable data engineering solutions.

AWS

Azure

Cloud

ETL

Google Cloud Platform

MS SQL Server

PySpark

Python

Spark

SQL

SSIS

Vault

🕒 Yesterday

Fortrea

10,000+ employees

🧬 Biotechnology

💊 Pharmaceuticals

⚕️ Healthcare Insurance

Data Architect developing data architecture and ETL workflows for innovative drug development solutions. Collaborating with teams to drive company performance and efficiency.

Azure

ETL

Hadoop

MongoDB

NoSQL

Oracle

SQL

🕒 Yesterday

Moniepoint Inc. (Formerly TeamApt Inc.)

1001 - 5000

💳 Fintech

🏦 Banking

Senior Data Engineer building and maintaining robust data pipelines for Moniepoint, Africa’s all-in-one financial platform. Optimizing the data platform and collaborating with functional teams.

AWS

Azure

Cloud

Python

SQL

🕒 Yesterday

Everest Technologies, Inc

51 - 200

🤝 B2B

☁️ SaaS

Senior Data Engineer at ETech designing data pipelines for AI context and knowledge systems. Focus on implementing Vector Databases and managing data governance for AI.

BigQuery

Cloud

NoSQL

Pandas

PySpark

Python

SQL

.NET

🕒 2 days ago

Irth Solutions

51 - 200

☁️ SaaS

⚡ Energy

📡 Telecommunications

Data Engineer implementing scalable data pipelines for Irth Solutions’ multi-cloud data estate. Collaborate with the Senior Data Architect to ensure reliable, secure, and high-performance data architectures.

🇮🇳 India – Remote

💰 Private Equity Round on 2015-07

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

Airflow

AWS

Azure

Cloud

ETL

Google Cloud Platform

PySpark

Spark

SQL

Unity