Senior Data Engineer – Azure Databricks

Job not on LinkedIn

🔥 0 minutes ago

🇧🇷 Brazil – Remote

⏰ Full Time

🟠 Senior

☁️ Cloud Engineer

👻 Ghost score 20%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

AVANTTi

WebsiteLinkedInAll Job Openings

51 - 200 employees

💼 Consulting

📦 Logistics

🏭 Manufacturing

Consulting • Logistics • Manufacturing

AVANTTi is a Brazilian technology services company that helps organizations maximize the value of their technology and innovation projects through its VMO (Value Management Office) methodology. It offers IT staffing and hunting (outsourcing/bodyshop), rapid squad formation, a software factory for technologies like ABAP, Java and . NET, and portfolio/SAFe management to support digital transformation across sectors such as banking, manufacturing, logistics, retail and education. The company operates from Curitiba, São Paulo and Rio de Janeiro and focuses on B2B delivery, enterprise IT solutions and talent allocation.

📋 Description

• Develop, maintain, and optimize data pipelines using Azure Databricks, PySpark, Azure Data Factory, Python, and Azure Data Lake • Build and support ETL/ELT processes for enterprise data integration and analytical needs • Perform data ingestion, transformation, validation, and reconciliation from multiple systems • Conduct data analysis and profiling, identifying quality issues and ensuring the consistency and reliability of information • Develop, write, and optimize complex SQL queries to achieve high-performance data processing • Perform performance tuning and troubleshooting for large-scale workloads • Resolve Level 2 production incidents involving Azure Data Factory pipelines, Databricks jobs, and data processing workflows • Monitor and support production pipelines, ensuring availability, scalability, and operational efficiency • Support deployment and release processes across development, staging, and production environments • Manage priorities and demands across multiple projects, working autonomously and with a strong focus on meeting deadlines

🎯 Requirements

• More than 8 years of experience in Data Engineering • Proven experience in Data Engineering and ETL process development • Strong hands-on experience with Azure Databricks and Azure Data Factory (ADF) • Advanced proficiency in ETL/ELT development and data transformation • Advanced SQL skills, including the development, optimization, and tuning of complex queries • Experience with Python and PySpark • Experience with Azure Data Lake and enterprise data integration • Experience with data analysis, validation, profiling, and quality assurance • Experience supporting, monitoring, and troubleshooting production pipelines • Ability to work independently, stay organized, and manage priorities • Strong verbal and written communication skills • Advanced English proficiency is required • Preferred: experience with CI/CD pipelines and DevOps practices • Preferred: knowledge of Git, Azure DevOps, or similar version control and deployment tools • Preferred: familiarity with monitoring, logging, and observability tools in cloud environments

🏖️ Benefits

• CLT employment contract • Fully remote work