Data Platform Engineer

Job not on LinkedIn

🕒 August 20

🇧🇷 Brazil – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

👻 Ghost score 38%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Cloudary

WebsiteLinkedInAll Job Openings

51 - 200 employees

🤝 B2B

🎯 Recruiter

💼 Consulting

B2B • Recruitment • Consulting

Cloudary is a B2B talent and staffing company that provides Principal‑vetted cloud engineering and architecture talent exclusively to public cloud consulting and technology partners. They offer staff augmentation (rapid, white‑label deployment with near‑shore/on‑shore teams) and permanent placement services focused on senior Cloud, Data & AI roles, with an AWS specialty and fluency across GCP and Azure. Cloudary emphasizes Principal‑led live technical vetting, partner‑exclusive engagements, strict compliance (GDPR/AI), LATAM‑distributed teams for North American time‑zone alignment, and value propositions such as fast deployment (≤11 days for augmentation), median req‑to‑offer in ≤21 days for hiring, success‑only recruiting fees, high retention (90%+) and strong CSAT metrics.

📋 Description

• Convert Azure Data Factory pipelines into Databricks workflows on AWS using reusable templates • Rehost Databricks workspaces onto AWS and migrate ADLS Gen2 storage to S3 • Rewrite ADF Web Activities as Lambda functions or Step Functions tasks • Replace ADF-specific scaling with native Databricks mechanisms • Build and tune PySpark transformations for production data volumes • Replace Azure Synapse Serverless with Databricks SQL Warehouse • Reconcile migrated data against source systems • Migrate 2,094 ADF pipelines, translate 9,859 pipeline activities, move 471 Spark dataflows to Databricks on AWS, and rehost four Databricks workspaces across Dev, QA, Pre-prod, and Prod

🎯 Requirements

• Production experience with Databricks, including workspaces, jobs, and workflows • Strong Spark and PySpark experience with real data volumes, including tuning • Production-grade Python • Experience building or migrating Azure Data Factory pipelines and solid understanding of the ADF activity model • Experience with AWS data services: S3, Glue, Athena, Lambda, and Step Functions • Advanced SQL, including reading and reasoning about stored procedures • Professional written and spoken English • Nice to have: Delta Lake, Unity Catalog, Azure Synapse, Terraform, Airflow/MWAA, dbt, Kafka, Databricks certification, data modeling, Great Expectations, SAS/analytics platform integration, and CRM data

🏖️ Benefits

• 100% remote work • Full-time engagement

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume