Data Platform Engineer

Job not on LinkedIn

🔥 3 minutes ago

🇧🇷 Brazil – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

👻 Ghost score 13%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Siteup

WebsiteLinkedInAll Job Openings

1 - 10 employees

Founded 2024

💼 Consulting

📣 Marketing

🤝 B2B

Consulting • Marketing • B2B

Siteup is a company that focuses on elevating online presence through innovative web and app development solutions, as well as strategic digital marketing services. They specialize in creating custom websites and mobile apps that aim to engage users and drive business growth.

📋 Description

• Convert Azure Data Factory pipelines into Databricks workflows on AWS using reusable templates • Rehost Databricks workspaces onto AWS and migrate ADLS Gen2 storage to S3 • Rewrite ADF Web Activities as Lambda functions or Step Functions tasks • Replace ADF-specific scaling with native Databricks mechanisms • Build and tune PySpark transformations for production data volumes • Replace Azure Synapse Serverless with Databricks SQL Warehouse • Reconcile migrated data against source systems • Migrate 2,094 ADF pipelines, translate 9,859 pipeline activities, move 471 Spark dataflows to Databricks on AWS, and rehost four Databricks workspaces across Dev, QA, Pre-prod, and Prod

🎯 Requirements

• Production experience with Databricks, including workspaces, jobs, and workflows • Strong Spark and PySpark experience with real data volumes, including tuning • Production-grade Python • Experience building or migrating Azure Data Factory pipelines and solid understanding of the ADF activity model • Experience with AWS data services: S3, Glue, Athena, Lambda, and Step Functions • Advanced SQL, including reading and reasoning about stored procedures • Professional written and spoken English • Nice to have: Delta Lake, Unity Catalog, Azure Synapse, Terraform, Airflow/MWAA, dbt, Kafka, Databricks certification, data modeling, Great Expectations, SAS/analytics platform integration, and CRM data

🏖️ Benefits

• 100% remote work • Full-time engagement