Data Engineer, Mid-Level

Job not on LinkedIn

🔥 1 minute ago

🇧🇷 Brazil – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

👻 Ghost score 10%

infoinfo

🗣️🇧🇷🇵🇹 Portuguese Required

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Stefanini Brasil

Stefanini Brasil

10,000+ employees

Founded 1987

💼 Consulting

🏥 Healthcare

📦 Logistics

Consulting • Healthcare • Logistics

Stefanini Brasil is a leading provider of digital transformation solutions, offering a range of services including artificial intelligence, cybersecurity, cloud enablement, and consulting. With over 35 years of experience, the company focuses on integrating innovative technologies to help organizations enhance their operations and customer experiences across various industries. Their expertise extends to sectors like healthcare, retail, and industrial goods, enabling businesses to optimize processes and drive value through technology.

📋 Description

• Lead the end-to-end migration of tables and pipelines from the Cloudera Hadoop environment to AWS, from initial assessment through production stabilization • Map jobs, pipelines, and HQL queries in Cloudera • Map Shell Script orchestration routines • Convert HQL queries to Amazon Athena, AWS Glue, or Amazon EMR, selecting the appropriate service based on cost, performance, and access patterns • Redesign Shell Script orchestration routines using Step Functions, Lambda, EventBridge, and MWAA/Airflow • Design the target data lake in Amazon S3 across the raw, trusted, and refined zones • Design solutions in Amazon Redshift where applicable

🎯 Requirements

• Experience with Cloudera Hadoop, HQL, Shell Script, Amazon Athena, AWS Glue, Amazon EMR, AWS Step Functions, AWS Lambda, Amazon EventBridge, Amazon MWAA/Airflow, Amazon S3, and Amazon Redshift • Experience migrating data and pipelines between different environments is a plus • Knowledge of other Big Data and Cloud technologies is a plus

🏖️ Benefits

• Meal voucher or food allowance • Discounts on courses, universities, and language institutions • Stefanini Academy — a platform offering free, up-to-date online courses with certificates • Mentoring • Benefits program offering discounts on consultations and medical tests • Health insurance • Dental insurance • Benefits and discounts at leading establishments • Travel club • Pet benefits program

Apply Now

Similar Jobs

🔥 12 hours ago

Sistema Fibra

1001 - 5000

🤝 B2B

🤝 Non-profit

📚 Education

Bolsista mestre pesquisando arquiteturas temporais e engenharia de dados para o Itaú. Desenvolvendo protótipos de eventos e jornadas para inovação financeira.

🗣️🇧🇷🇵🇹 Portuguese Required

🔥 12 hours ago

Sistema Fibra

1001 - 5000

🤝 B2B

🤝 Non-profit

📚 Education

Bolsista mestre pesquisando arquiteturas temporais e engenharia de dados para a Timeline Inteligente do Cliente no Itaú. Desenvolvendo protótipos de oportunidades baseadas em eventos.

🗣️🇧🇷🇵🇹 Portuguese Required

🔥 23 hours ago

Leega

201 - 500

💼 Consulting

📣 Marketing

🔌 API

Engenheiro de Dados GCP sênior construindo pipelines e plataformas analíticas para varejo. Transformando dados em soluções escaláveis na nuvem Google Cloud para clientes da Leega.

🗣️🇧🇷🇵🇹 Portuguese Required

🕒 Yesterday

Cadastra

501 - 1000

🛍️ eCommerce

📣 Marketing

☁️ SaaS

Engenheira de Dados Sênior projetando pipelines e soluções de dados escaláveis na Cadastra. Contribuindo para arquitetura, segurança, observabilidade, governança e evolução técnica.

🗣️🇧🇷🇵🇹 Portuguese Required

🕒 Yesterday

Sigma Software Group

1001 - 5000

💼 Consulting

🏥 Healthcare

🚘 Automotive

Middle Data Engineer building ETL/ELT pipelines and cloud data platforms at Sigma Software. Optimizing analytics infrastructure with Python, Spark, Databricks, Snowflake, and AWS.