Data Engineer – Silver Conversions, Scheduling

Job not on LinkedIn

🔥 11 minutes ago

🇨🇦 Canada – Remote

💵 $82 - $95 / hour

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

PLATO

WebsiteLinkedInAll Job Openings

201 - 500 employees

Founded 1997

💼 Consulting

🤝 B2B

🏢 Enterprise

💰 $2M Seed Round - Plato Testing on 2022-05

Consulting • B2B • Enterprise

PLATO is Canada’s largest Indigenous-owned software testing and technology services company. For nearly 30 years it has partnered with enterprises to deliver reliable digital products through software testing, quality assurance, risk mitigation, system stability, and user-experience improvements. PLATO operates a 100% Canada-based workforce offering testing services, IT and business consulting, and training programs that include Indigenous-focused recruitment and guaranteed employment to increase Indigenous participation in the tech workforce.

📋 Description

• Develop Silver-layer conversion and transformation pipelines using Microsoft Fabric, Azure Data Factory, Spark, and Delta Lake • Build and maintain scheduling and orchestration of Silver pipelines, including dependencies, retries, and failure handling • Use reusable PySpark libraries and metadata-driven configuration to speed delivery • Apply standard error handling, logging, monitoring, and unit-testing patterns • Support reconciliation, checkpointing, replay, and recovery to maintain data integrity • Tune Spark workloads for performance and cost efficiency

🎯 Requirements

• Minimum 5 years of experience with Microsoft Fabric (Data Factory, Lakehouse), PySpark, Spark SQL, Delta Lake, Azure Data Factory, and Azure Storage • Experience with pipeline orchestration and scheduling using Fabric Data Factory / Azure Data Factory • Experience with PySpark and Spark SQL data transformation • Microsoft Purview exposure for cataloguing and lineage • Experience with Azure DevOps, Git, and CI/CD pipelines • Active Reliability security clearance • Eligible for Secret clearance

🏖️ Benefits

• Collaborative environment • Mentorship and coaching • Knowledge-sharing opportunities • Inclusive hiring practices • Accommodation support during the recruitment process