Senior Data Engineer – Databricks, Unity Catalog

🔥 3 minutes ago

🇧🇷 Brazil – Remote

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 10%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Stefanini Brasil

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1987

💼 Consulting

🏥 Healthcare

📦 Logistics

Consulting • Healthcare • Logistics

Stefanini Brasil is a leading provider of digital transformation solutions, offering a range of services including artificial intelligence, cybersecurity, cloud enablement, and consulting. With over 35 years of experience, the company focuses on integrating innovative technologies to help organizations enhance their operations and customer experiences across various industries. Their expertise extends to sectors like healthcare, retail, and industrial goods, enabling businesses to optimize processes and drive value through technology.

📋 Description

• Develop, optimize, and maintain data transformation pipelines using dbt Core and Databricks (Unity Catalog, Delta Lake, Spark SQL) • Apply dimensional modeling (Star Schema) for efficient consumption in BI tools • Ensure data quality and governance by writing generic and singular tests in dbt and performing rigorous source-to-target validations • Work independently from business rules specifications, identifying inconsistencies and proposing efficient technical solutions • Version code and pipelines using Git workflows, Merge Requests, and CI/CD concepts via GitLab • Create and maintain supporting Python scripts and assist with understanding orchestration DAGs

🎯 Requirements

• Advanced SQL: Proficiency in CTEs, window functions, deduplication techniques, data handling (dates/numbers), and support for Slowly Changing Dimensions (SCD Type 2) • dbt Core in Production: Hands-on experience with models, sources, tests, seeds, snapshots, Jinja macros, materializations (ephemeral, incremental), contracts, and use of the ref/var functions • Databricks: Experience with Unity Catalog, Delta Lake, SQL Warehouse, and Spark SQL • Data Modeling: Experience with dimensional modeling (Star Schema) focused on high performance in Power BI • Version Control & Scripting: Proficiency in Git, Merge Request workflows, familiarity with CI/CD in GitLab, and functional Python skills for automation and DAG reading • Technical English at a minimum B2 level for reading and writing technical documentation • Preferred: 5 or more years of prior experience in Data Engineering • Preferred: Experience with orchestration using Apache Airflow, especially AWS MWAA, and the Cosmos library for dbt execution • Preferred: Knowledge of SAP ECC data, PM and CO modules, or BODS pipelines • Preferred: Knowledge of AWS architecture (S3) and Lakehouse Federation

🏖️ Benefits

• Meal allowance or meal voucher • Discounts on courses, universities, and language institutions • Stefanini Academy — a platform offering free, up-to-date online courses with certificates • Mentoring • Benefits club for consultations and medical exams • Health insurance • Dental insurance • Benefits and discounts at leading establishments • Travel club • Pet insurance partnership