Data Engineer

🔥 2 minutes ago

🌽 Illinois – Remote

🌽 Illinois – Remote

💵 $100k - $170.5k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 2%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Allstate

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1931

💼 Consulting

📦 Logistics

🛡️ Insurance

💰 Post-IPO Equity on 2014-01

Consulting • Logistics • Insurance

Allstate is an industry leader in providing insurance solutions, focusing on home, auto, device, and identity protection. With a commitment to customer well-being, Allstate aims to instill peace of mind and financial security for its customers. The company also emphasizes community impact and sustainability through various initiatives, showcasing their dedication to social responsibility and positive change.

📋 Description

• Design, build, and maintain trusted risk data products and scalable batch and streaming data pipelines using cloud-native technologies • Integrate data from risk platforms, control systems, vendor tools, operational applications, and external sources into governed, analytics-ready datasets • Develop and optimize ETL/ELT workflows for automated data ingestion, transformation, validation, reconciliation, and delivery • Build and manage data processing workloads in modern data lake and lakehouse environments, including Microsoft Fabric and OneLake • Implement data quality, monitoring, lineage, and reconciliation processes • Create curated datasets and analytical outputs for operational reporting, leadership dashboards, trend analysis, risk identification, and decision-making • Optimize data architectures, schemas, and processing patterns for scalability, performance, resilience, and cost efficiency • Develop reusable frameworks, engineering standards, CI/CD pipelines, automated testing, and operational monitoring • Partner with analytics, product, risk, governance, security, and compliance stakeholders on data definitions, metrics, quality standards, and secure data access • Participate in Agile delivery activities including sprint planning, backlog refinement, design reviews, and continuous improvement initiatives

🎯 Requirements

• 4+ years of experience as a Data Engineer or in a similar role building and supporting production-grade data pipelines and data products • Hands-on experience with Apache Spark for large-scale data processing and transformation • Strong proficiency in Python, SQL, and modern data engineering best practices • Experience developing ETL/ELT solutions within cloud-based data lake, lakehouse, or analytics platforms • Experience designing and optimizing analytical data models supporting reporting, dashboards, operational insights, and advanced analytics • Strong understanding of data quality, validation, monitoring, reconciliation, and production support processes • Experience with CI/CD pipelines, version control, automated testing, and infrastructure-as-code concepts • Ability to troubleshoot complex data quality, performance, and integration issues across multiple data sources • Strong verbal and written communication skills • Experience with Microsoft Fabric, OneLake, or similar modern analytics platforms preferred • Experience working with risk, controls, compliance, audit, governance, or regulatory data domains • Experience building real-time, near real-time, or event-driven data processing solutions • Familiarity with data governance, metadata management, data lineage, access controls, and enterprise data quality frameworks • Experience with orchestration and workflow management tools for data pipelines • Experience supporting operational reporting, executive dashboards, trend analysis, advanced analytics, or machine learning initiatives • Background investigation required • Reliable internet with minimum speeds of 50 MB download and 5 MB upload • Dedicated, private workspace free from distractions with appropriate desk and seating • Allstate generally does not sponsor individuals for employment-based visas for this position

🏖️ Benefits

• Comprehensive technology setup including a laptop, monitors, headset, keyboard, and mouse • Monthly connectivity reimbursement for employees eligible to work from home