Lead Data Engineer

Job not on LinkedIn

🔥 0 minutes ago

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of CampusWorks, Inc.

CampusWorks, Inc.

51 - 200 employees

Founded 1999

💼 Consulting

🏥 Healthcare

📦 Logistics

Consulting • Healthcare • Logistics

CampusWorks, Inc. is a company that partners with institutions of higher education to solve challenges and improve student outcomes through strategic planning and technological solutions. They specialize in managed services, IT optimization, strategic planning, enterprise solutions, technology management, and staffing augmentation. CampusWorks offers tailored solutions to streamline operations, enhance efficiency, and align technology with institutional missions. Their services include AI enablement, enterprise system evaluations, staff augmentation, and shared services, among others. By focusing on meaningful relationships with campuses, they help institutions reach their full potential and foster a thriving educational environment.

📋 Description

• Build and maintain batch data pipelines that ingest from Workday (HCM, Finance, Student) and legacy source systems into the Bronze layer • Develop transformation logic across Bronze / Silver / Gold layers using Spark, Python, and SQL on Databricks • Model data for analytics consumption, balancing performance, reliability, and maintainability • Orchestrate and schedule workloads (e.g., Databricks Workflows, Azure Data Factory, or Fabric pipelines) and monitor them for reliability • Implement data-quality checks and validation within pipelines • Serve as senior technical lead on complex integrations and cross-institution data workstreams (Lead Data Engineer) • Define and enforce engineering standards, patterns, and best practices • Mentor and provide technical guidance and code review to other engineers

🎯 Requirements

• Data Engineer: 3–6 years building production data pipelines • Lead Data Engineer: 7–10 years, with demonstrated technical leadership • Hands-on expertise with Apache Spark, Python, and SQL in a Databricks environment • Experience designing and building medallion or layered data architectures (Bronze / Silver / Gold or equivalent) • Proven experience integrating data from multiple ERP / SIS / operational source systems into an analytics platform • Experience with batch pipeline orchestration and scheduling (Databricks Workflows, Azure Data Factory, or similar) • Working understanding of data governance, security, and access concepts in a shared or multi-tenant environment • Strong problem-solving skills with a consistent focus on data quality and reliability • Excellent communication and collaboration skills on a remote team • Bachelor’s degree in a technical field or equivalent practical experience

🏖️ Benefits

• Competitive pay • Robust benefits for full-time employees • Professional development opportunities • Flexibility for work-life balance • Charitable fundraising initiatives

Apply Now

Similar Jobs

🔥 14 minutes ago

Hyatt

10,000+ employees

🍽️ Food & Beverage

✈️ Travel

🛒 Retail

Product Manager for Customer Data Platform at Hyatt, collaborating with global teams to enhance customer insights and drive data-driven marketing.

🔥 1 hour ago

Effectual

201 - 500

💼 Consulting

🤖 Artificial Intelligence

Data Engineer responsible for building and maintaining the data architecture that supports Effectual’s business needs. Develop scalable data pipelines and ensure data management for analysis and reporting.

🔥 2 hours ago

RTX

10,000+ employees

🚀 Aerospace

🎖️ Defense

🏭 Manufacturing

Manager, Data Architect overseeing HR data architecture and ETL processes at RTX. Collaboration with cross-functional teams to implement data governance and integrity standards.

🇺🇸 United States – Remote

💵 $107.5k - $204.5k / year

💰 $200k Grant - RTX on 2024-11

⏰ Full Time

🟠 Senior

🔴 Lead

🚰 Data Engineer

Cloud

ETL

Matillion

SQL

🔥 3 hours ago

Cisco

10,000+ employees

🔧 Hardware

🔐 Security

🏢 Enterprise

Product Manager leading data and telemetry strategy for Meraki Cloud Platform. Collaborating with product teams and engineers to enhance cloud-managed networking capabilities.

🔥 3 hours ago

T-Rex Solutions, LLC

201 - 500

🔒 Cybersecurity

🏛️ Government

Enterprise Data Architect leading data transformation for IRS legacy systems modernization. Involved in data analysis, conversion, and validation processes for improved taxpayer experience.