Search Remote Jobs

Big Data Engineer

Job not on LinkedIn

πŸ”₯ 3 hours ago

Apply Now
Find Similar Remote Jobs

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Dayforce

Dayforce

5001 - 10000 employees

πŸ‘₯ HR Tech

☁️ SaaS

🏒 Enterprise

πŸ’° $1G Post-IPO Debt - Dayforce on 2024-03

HR Tech β€’ SaaS β€’ Enterprise

Dayforce is a cloud-based human capital management (HCM) platform that provides payroll, workforce management, time and attendance, benefits administration, talent management, and HR tools as an integrated SaaS solution for employers. It is designed to help organizations manage payroll, scheduling, compliance, and employee lifecycle processes in a single unified application.

πŸ“‹ Description

β€’ Design and deliver scalable, secure data pipelines and data models that safely connect operational systems to analytics. β€’ Ensure trusted and well‑governed data, enabling repeatable delivery of BI, ML, AI, and automation solutions. β€’ Build ingestion pipelines (batch, CDC, streaming) from various sources into landing, curated, and semantic layers. β€’ Implement data contracts, schema/versioning, SCD handling, partitioning, and performance tuning. β€’ Develop dimensional/semantic models that back certified Power BI datasets and APIs for apps/agents. β€’ Integrate OT data via OPC UA/MQTT and collaborate on change control and signal quality. β€’ Embed data quality rules and instrument lineage and end-to-end monitoring; build alerting and on-call runbooks. β€’ Automate build/test/deploy with Git-based CI/CD; track and optimize cost/performance; contribute to FinOps reviews. β€’ Partner with Reporting & BI on semantic model contracts and produce documentation.

🎯 Requirements

β€’ Minimum 5 years' in data engineering building production pipelines at scale (batch/CDC/streaming). β€’ Hands-on with Azure data stack: Databricks or Fabric/Synapse, ADF/Pipelines, ADLS/OneLake, Azure SQL/SQL MI, Key Vault. β€’ Strong SQL and Python/PySpark; comfort with Spark Structured Streaming and performance tuning. β€’ Experience implementing tests/observability (freshness, schema, expectations), and Git-based CI/CD. β€’ Familiarity with SAP S/4HANA structures and SAP DataSphere semantic modeling. β€’ OT concepts: historians (PHD/PI), OPC UA/MQTT, event/batch frames, ISA-95/99 basics. β€’ Understanding of Power BI consumption (semantic models, RLS) and APIs for downstream AI/ML apps/agents.

Apply Now

Similar Jobs

πŸ”₯ 4 hours ago

PressW

11 - 50

πŸ€– Artificial Intelligence

☁️ SaaS

πŸ’Ό Consulting

Lead data engineering efforts for healthcare scheduling platform rebuild at PressW. Collaborate with teams to design schemas, build translation layers, and ensure data consistency.

πŸ”₯ 4 hours ago

Surge AI

51 - 200

πŸ€– Artificial Intelligence

πŸ”Œ API

☁️ SaaS

Software Engineer designing coding data projects for AI systems at Surge. Collaborating across teams to enhance coding quality and evaluations in frontier models.

πŸ”₯ 4 hours ago

Surge AI

51 - 200

πŸ€– Artificial Intelligence

πŸ”Œ API

☁️ SaaS

Research Engineer at Surge working at the intersection of software engineering and AI training data. Owning coding data projects to teach frontier models how to code.

πŸ”₯ 4 hours ago

Surge AI

51 - 200

πŸ€– Artificial Intelligence

πŸ”Œ API

☁️ SaaS

Human Data Architect designing data systems for frontier AI models at Surge. Focused on data collection methodologies and scalability of training data systems.

πŸ”₯ 4 hours ago

The Voleon Group

201 - 500

πŸ’Έ Finance

πŸ€– Artificial Intelligence

Senior/Staff Software Engineer on Voleon's Data Engineering Team, applying AI and ML techniques to finance. Designing scalable data operations and mentoring engineering talent.