Senior Data Engineer

🔥 15 hours ago

🐊 Florida, Illinois, +3 more states – Remote

infoinfo

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 10%

infoinfo
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Independence Pet Group

Independence Pet Group

1001 - 5000 employees

🛡️ Insurance

👥 B2C

🧘 Wellness

Insurance • B2C • Wellness

Independence Pet Group is one of North America’s largest pet insurance and services organizations. The company supports insurance for more than 800,000 pets in the U. S. and Canada, with a mission to strengthen the bond between pets and their owners through innovative products and services. IPG offers a comprehensive range of underwriting options, turnkey partner solutions, and consumer-facing insurance products to support pets throughout their lives. The company is home to several insurance brands, providing vital support and services in the pet care industry.

📋 Description

• Build data pipelines across the medallion architecture. • Develop and optimize data pipelines using Databricks, integrating data from various sources. • Optimize pipeline performance for greater efficiency and cost-effectiveness. • Design and implement data models in the data lake environment. • Implement data quality controls and validation procedures throughout the data pipeline. • Comply with data governance policies and best practices. • Integrate Databricks with Azure cloud services for storage, compute, and security, including Azure Data Lake Storage. • Support product development processes through accurate and reliable data flows.

🎯 Requirements

• Bachelor’s degree in computer science, Information Technology, or related field. • At least 7 years of experience in building data pipelines using ELT/ETL. • Experience working with Databricks, Spark, and Azure data services. • Strong coding skills with Python, SQL and PySpark. • Experience designing and maintaining config-driven pipelines with support for Change Data Capture (CDC) and event/stream-based processing. • Proficiency with NoSQL and SQL databases. • Strong understanding of data modeling, schema design, and database performance optimization. • Practical experience working with various file formats, including JSON, Parquet, and ORC. • Hands-on experience building and maintaining CI/CD pipelines (Azure DevOps, GitLab) and automating data workflow deployments. • Solid understanding of data governance, lineage, and cloud security (Unity Catalog, encryption, access control). • Excellent problem-solving and analytical skills. • Experience with data modeling tools and techniques. • Knowledge of cloud-based data solutions and platforms.

🏖️ Benefits

• Comprehensive full medical, dental and vision Insurance • Basic Life Insurance at no cost to the employee • Company paid short-term and long-term disability • 12 weeks of 100% paid Parental Leave • Health Savings Account (HSA) • Flexible Spending Accounts (FSA) • Retirement savings plan • Personal Paid Time Off • Paid holidays and company-wide Wellness Day off • Paid time off to volunteer at nonprofit organizations • Pet friendly office environment • Commuter Benefits • Group Pet Insurance • On the job training and skills development • Employee Assistance Program (EAP)

Apply Now

Similar Jobs

🔥 18 hours ago

Virtru

51 - 200

💼 Consulting

🏥 Healthcare

📦 Logistics

Data warehouse architect designing scalable lakehouse and analytics infrastructure for Virtru’s secure data-sharing platform. Leading SRE, technical architecture, and engineering mentorship.

🔥 19 hours ago

Jones Lang LaSalle Americas, Inc.

10,000+ employees

🏠 Real Estate

🤝 B2B

💼 Consulting

Data center commissioning engineer supporting JLL’s US commissioning services. Testing electrical, mechanical, and controls systems across major data center projects.

🔥 23 hours ago

ClassLink

51 - 200

📚 Education

🔒 Cybersecurity

☁️ SaaS

Senior data engineer building AI-enabled cloud platforms and data services for ClassLink’s education technology products. Leading architecture, AWS optimization, enterprise integrations, and engineering standards.

🔥 23 hours ago

The Helper Bees

51 - 200

🏥 Healthcare

📦 Logistics

💼 Consulting

Data engineering and analytics manager leading governed pipelines, reporting, and ML initiatives. Advancing The Helper Bees’ mission to improve affordable in-home care for older adults.

🕒 Yesterday

High Bridge Consulting LLC

51 - 200

💼 Consulting

📣 Marketing

📦 Logistics

Senior AI/Data Engineer building production multi-agent and RAG solutions for High Bridge’s enterprise consulting engagements. Deploying secure, cloud-based AI workflows and validation pipelines.