Data Engineer – AWS, Databricks

🔥 2 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Stefanini Brasil

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1987

🤖 Artificial Intelligence

🔒 Cybersecurity

Artificial Intelligence • Cybersecurity • Cloud

Stefanini Brasil is a leading provider of digital transformation solutions, offering a range of services including artificial intelligence, cybersecurity, cloud enablement, and consulting. With over 35 years of experience, the company focuses on integrating innovative technologies to help organizations enhance their operations and customer experiences across various industries. Their expertise extends to sectors like healthcare, retail, and industrial goods, enabling businesses to optimize processes and drive value through technology.

📋 Description

• Build and maintain data ingestion, transformation, and curation pipelines; • Develop ELT/ETL pipelines using PySpark and SQL across Medallion layers; • Implement data quality rules, monitoring, and remediation standards; • Perform data profiling and source inventory for assessment and governance; • Catalog datasets and apply data handling policies compliant with the LGPD (Brazilian Data Protection Law) using Unity Catalog; • Work on API integration, multiple data sources, and orchestration processes.

🎯 Requirements

• Strong experience as a Data Engineer; • Databricks (Delta Lake); • PySpark and SQL; • Building ELT/ETL pipelines; • Medallion architecture; • Batch and streaming ingestion (Auto Loader, Kafka, and Structured Streaming); • Dimensional modeling and Data Vault; • dbt and/or Delta Live Tables (DLT); • Data quality frameworks (Great Expectations, DLT Expectations); • Observability and pipeline monitoring; • Orchestration with Databricks Workflows and/or Apache Airflow; • Integration with APIs and various data sources; • Fluent English is essential for conversation.

🏖️ Benefits

• Meal or food allowance (meal voucher); • Discounts on courses, universities, and language schools; • Stefanini Academy — platform with free, up-to-date online courses with certificates; • Mentoring; • Benefits club for medical consultations and exams; • Health insurance; • Dental insurance; • Perks and discounts at leading establishments; • Travel club; • Pet care plan/partnership.