Lead Data Engineer – Databricks

🕒 April 14

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of AmeriLife

AmeriLife

1001 - 5000 employees

Founded 1973

💸 Finance

💰 Secondary Market on 2022-06

Finance • Insurance

AmeriLife is a leading independent marketing organization and registered investment advisor in the United States. It provides comprehensive insurance and financial solutions to agents, advisors, and consumers, aiming to help people live longer, healthier lives. AmeriLife collaborates with numerous carriers, financial marketing organizations (FMOs), and industry experts to deliver health and financial solutions to millions of Americans annually. With a vast network of over 300,000 client-centered agents and advisors, AmeriLife offers advanced technology solutions and tools, like the Agent Xcelerator®, to enhance service quality and business growth. Their commitment to leadership is evident in their extensive distribution network and innovative partnership opportunities.

📋 Description

• Design and build scalable Databricks data pipelines • Develop ETL/ELT pipelines using PySpark • Implement data ingestion and transformation frameworks • Optimize Spark workloads for performance and scalability • Establish engineering standards and mentor engineers • Collaborate with architecture and analytics teams to enable data products

🎯 Requirements

• Strong expertise in Python and SQL • Deep experience with Databricks, PySpark, and Spark • Experience building large-scale data pipelines • Strong understanding of data transformation and distributed processing • Databricks certification (Bonus) • AWS or Azure certification (Bonus)

🏖️ Benefits

• PTO • medical • dental • vision • retirement savings • disability insurance • life insurance

Apply Now

Similar Jobs

🕒 April 14

Allata

201 - 500

🤝 B2B

Software Manager leading engineering teams to build data-driven solutions at Allata. Focused on modern data platforms and large-scale data initiatives with initial training included.

Cloud

ETL

Python

SQL

🕒 April 14

Allata

201 - 500

🤝 B2B

Senior Software Engineer transitioning to Data Engineering at Allata, a global consulting firm. Focused on modern data solutions and leveraging software engineering expertise.

Cloud

ETL

Python

SQL

🕒 April 14

Six Values

201 - 500

🤝 B2B

🎮 Gaming

Senior Data Warehouse Analyst taking ownership of analytics data structure and quality across multiple iGaming brands. Ensuring reliable data for reporting and decision-making with key responsibilities in collaboration and issue resolution.

SQL

🕒 April 14

nDeavour Consulting

1 - 10

🎯 Recruiter

👥 HR Tech

🤝 B2B

Data Architect defining and evolving data architecture for Mobile Wave Solutions' critical systems, shaping data models and governance frameworks with strategic thinking.

Airflow

Amazon Redshift

AWS

Microservices

PySpark

Python

Spark

SQL

Unity

🕒 April 14

SentiLink

51 - 200

🔐 Security

💳 Fintech

💸 Finance

Senior Software Engineer on the Data Platform team at SentiLink building data infrastructure for identity verification solutions. Collaborating with product and engineering on data platform enhancements.

Amazon Redshift

AWS

Azure

Cloud

ETL

Google Cloud Platform

Hadoop

Kafka

Kubernetes

NoSQL

Postgres

Python

RDBMS

Spark

Go