Azure Databricks Data Engineer

Job not on LinkedIn

🕒 April 9

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Exavalu

Exavalu

201 - 500 employees

Founded 2018

🤝 B2B

🏦 Banking

⚕️ Healthcare Insurance

B2B • Banking • Healthcare Insurance

Exavalu is a business advisory and technology consulting firm that partners with enterprises to deliver high-impact digital transformation. Run by former CIOs, CXOs, and consulting principals, Exavalu offers strategic advisory, core systems transformation, systems integration, data & analytics, innovation and privacy/compliance solutions across regulated sectors. The firm focuses on Insurance, Banking & Financial Services, and Healthcare & Life Sciences, providing industry-tailored technology implementations and program leadership using partners like Guidewire, Salesforce, MuleSoft, PegaSystems and AWS.

📋 Description

• Design and implement end-to-end data pipeline using Azure-native services and databricks. • This role focuses on building scalable, high-performance data platforms, defining robust data frameworks, and partnering with stakeholders to translate business requirements into reliable data solutions. • Implement data governance principles using unity catalog. • Create and Implement data ingestion patterns and data integration patterns in medallion architecture. • Apply best practices in data engineering. • Create Pyspark notebooks. • Create procedures for advanced data transformation. • Handle performance tuning aspects in Databricks and Azure SQL DBs.

🎯 Requirements

• Hands-on experience with Azure Databricks • Hands-on expertise in data ingestion, transformation, and orchestration frameworks. • Hands on experience in building Insurance specific data models • Proven ability to optimize data pipelines for performance, scalability, and cost efficiency. • Solid understanding of distributed data processing concepts. • Hands-on experience with PySpark for large-scale data processing. • Experience defining and enforcing best practices for Databricks workloads and Spark-based pipelines. • Strong analytical and problem-solving skills. • Excellent communication skills to effectively work with cross-functional stakeholders. • Prior experience in working in Insurance P&C cloud based data & analytics projects.

🏖️ Benefits

• Diversity Inclusion: Exavalu also promotes flexibility, adapting to the needs of employees, customers, and the business. It might be part-time work, working outside normal 9-5 business hours or working remotely. • We also offer a welcome back program to help individuals return to the mainstream after a prolonged absence due to health or family reasons. • At Exavalu, we are committed to building a diverse and inclusive workforce. We welcome applications for employment from all qualified candidates, regardless of race, colour, gender, national or ethnic origin, age, disability, religion, sexual orientation, gender identity or any other status protected by applicable law. We nurture a culture that embraces all individuals and promotes diverse perspectives, where you can make an impact and grow your career.

Apply Now

Similar Jobs

🕒 April 8

G-P

1001 - 5000

👥 HR Tech

📋 Compliance

☁️ SaaS

Lead data platform that powers every G-P product and AI workflow. Build high-performing teams and shape data architecture at scale.

Cloud

Distributed Systems

Python

SQL

🕒 April 8

Airbnb

5001 - 10000

👥 B2C

🛍️ eCommerce

Senior Data Engineer at Airbnb leading the design and implementation of data systems. Collaborating with cross-functional teams to drive data strategies and optimize data processes.

Amazon Redshift

BigQuery

Java

Kafka

MySQL

Postgres

Python

Scala

Spark

SQL

🕒 April 6

TechBiz Global

51 - 200

🎯 Recruiter

Senior Data Engineer and Data Architect at TechBiz Global. Overseeing data architecture and engineering, focusing on analytics and financial services.

Cloud

ETL

Informatica

SQL

🕒 April 1

Particle41

51 - 200

☁️ SaaS

🤖 Artificial Intelligence

🏢 Enterprise

Data Engineer focusing on Elasticsearch and data warehousing at Particle41. Building robust data pipelines and collaborating on impactful projects remotely.

AWS

Azure

Cloud

ElasticSearch

ETL

Flask

Google Cloud Platform

Java

Linux

Microservices

MongoDB

MySQL

NoSQL

Pandas

Postgres

PySpark

Python

Redis

Scikit-Learn

Spark

SQL

🕒 April 1

Zensark

11 - 50

🤖 Artificial Intelligence

💳 Fintech

Data Engineer at Tangoe focusing on optimizing data pipeline architectures and supporting data initiatives for product development. Collaborating with diverse teams to enhance data delivery and infrastructure.

Amazon Redshift

AWS

Cassandra

Cloud

EC2

Java

Node.js

NoSQL

Oracle

Postgres

Python

Spark

SQL