Senior Data Engineer – Airflow, AWS

Job not on LinkedIn

🔥 1 minute ago

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Stefanini Brasil

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1987

🤖 Artificial Intelligence

🔒 Cybersecurity

Artificial Intelligence • Cybersecurity • Cloud

Stefanini Brasil is a leading provider of digital transformation solutions, offering a range of services including artificial intelligence, cybersecurity, cloud enablement, and consulting. With over 35 years of experience, the company focuses on integrating innovative technologies to help organizations enhance their operations and customer experiences across various industries. Their expertise extends to sectors like healthcare, retail, and industrial goods, enabling businesses to optimize processes and drive value through technology.

📋 Description

• Develop, maintain, and evolve data pipelines using Apache Airflow (MWAA); • Build data ingestion, transformation, and provisioning processes (ETL/ELT); • Develop solutions using Python, Spark, and AWS services; • Implement and support data architectures in Data Lake, Lakehouse, and Data Warehouse environments; • Perform data modeling to meet analytical and business needs; • Ensure data quality, governance, and observability of processed data; • Monitor and optimize the performance of data pipelines and processes; • Collaborate with business, analytics, and technology teams to evolve the data platform; • Support the definition of best practices, standards, and continuous improvements across the data ecosystem.

🎯 Requirements

• Strong experience with Apache Airflow (MWAA) for orchestrating data pipelines; • Python development experience for building and maintaining ETL/ELT processes; • Advanced knowledge of SQL Server; • Experience with Apache Spark for large-scale data processing; • Experience with AWS services, particularly Redshift, S3, Glue, and MWAA; • Knowledge of data modeling for analytical environments; • Experience with Data Warehouse, Data Lake, and Lakehouse architectures; • Familiarity with Medallion architecture (Bronze, Silver, Gold); • Experience with data governance, quality, and observability; • Experience in developing, optimizing, and monitoring data pipelines.

🏖️ Benefits

• Meal allowance or meal voucher; • Discounts on courses, universities, and language schools; • Stefanini Academy — platform with free, up-to-date online courses and certificates; • Mentoring; • Benefits club for consultations and exams; • Health insurance; • Dental insurance; • Discount and perks club at top retailers and establishments; • Travel club; • Pet care benefits.