Lead Data Engineer, Brazil

🔥 12 hours ago

🇧🇷 Brazil – Remote

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 10%

infoinfo
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Experian

Experian

10,000+ employees

Founded 1996

💼 Consulting

📣 Marketing

📦 Logistics

Consulting • Marketing • Logistics

Experian is a global leader in digital experience, technology, and transformation. They partner with recognized brands to enhance customer understanding, innovate product strategies, and implement agile technology solutions. With a focus on delivering superior customer experiences through AI, cloud architecture, and project management, Experian helps businesses streamline their operations and achieve their objectives effectively.

📋 Description

• Design, implement, and evolve a petabyte-scale AWS data platform • Build and optimize scalable data pipelines using JVM languages, Spark, Python, and cloud-native services • Ensure efficient, resilient, and production-ready data processing for analytics and downstream products • Mentor engineers, lead code reviews, and promote engineering best practices • Contribute to architectural and design decisions with architects, product owners, and engineering leadership • Plan and deliver complex technical initiatives within agile value-stream teams • Ensure operational readiness through coding standards, testing, monitoring, and release procedures • Support production deployments and maintain platform stability • Explore and adopt GraphQL integrations, vector databases, and AI/LLM-based techniques • Collaborate with product, engineering, and operations teams to enable data-driven marketing solutions

🎯 Requirements

• Expert-level software and data engineering experience in large-scale data platforms • Deep experience building petabyte-scale systems using Java-based languages such as Scala and Apache Spark • Strong expertise across the AWS data ecosystem, including Glue, S3, Athena, Managed Airflow, and Iceberg • Advanced understanding of distributed systems and highly parallelized workloads • Strong skills in query optimization, data partitioning, and efficient storage patterns • AWS cloud ecosystem mastery; Azure/GCP are pluses • Experience influencing long-term architecture and platform design • Excellent code review, mentorship, and technical leadership capabilities • Hands-on experience working in agile environments and collaborating across multiple engineering teams • Strong version control and multi-repo collaboration skills with Git, GitHub, and Bitbucket • Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience • Advanced English • Availability to travel to São Carlos/SP when needed • Relevant experience • Experience with DBT or modern transformation frameworks • Knowledge of concurrent and parallel programming • Familiarity with Python, Angular, and TypeScript • Experience with vector databases such as pgvector and Redis vector fields • Practical experience applying AI/LLM techniques to data platforms, data access, or software quality

🏖️ Benefits

• Inclusive recruitment and professional development initiatives • Affinity groups supporting underrepresented groups: ExperianPride, Ubuntu, Women in Experian, Aspire, and Connecting Generations • Remote work option • Full-time regular employee status

Apply Now

Similar Jobs

🕒 Yesterday

Stefanini Brasil

10,000+ employees

💼 Consulting

🏥 Healthcare

📦 Logistics

Engenheiro de Dados Especialista apoiando exploração, limpeza e análise de dados na Stefanini. Construção de pipelines Python/PySpark e dashboards para decisões baseadas em dados.

🗣️🇧🇷🇵🇹 Portuguese Required

Airflow

Apache

AWS

Azure

Docker

PySpark

Python

Spark

SQL

SSIS

Terraform

🕒 Yesterday

Compass

10,000+ employees

🏠 Real Estate

📱 Media

Data Engineer building Databricks MLOps pipelines for Compass UOL’s AI-driven digital platforms. Managing scalable data pipelines, model lifecycle automation, and Delta Lake organization.

🗣️🇧🇷🇵🇹 Portuguese Required

Airflow

Apache

AWS

BigQuery

Cassandra

Google Cloud Platform

Kafka

MongoDB

NoSQL

Postgres

PySpark

Spark

SQL

Unity

🕒 Yesterday

Rimini Street

1001 - 5000

💼 Consulting

🏥 Healthcare

📦 Logistics

AI Data Engineer building RAG pipelines, vector infrastructure, and knowledge architecture. Powering Rimini Street’s Agentic ERP Platform for enterprise software support.

Airflow

AWS

Cloud

ERP

ETL

GraphQL

Open Source

Pandas

Postgres

Python

ServiceNow

SQL

🕒 2 days ago

tapouts

11 - 50

📚 Education

🧘 Wellness

Senior Data Engineer building scalable cloud data infrastructure for tapouts, a child-wellbeing mission organization. Developing pipelines, dashboards, lakehouse architectures, and ML data workflows.

Airflow

Amazon Redshift

Apache

AWS

Azure

BigQuery

Cloud

ETL

Google Cloud Platform

Kafka

Python

Spark

SQL

🕒 2 days ago

Onzze

1 - 10

💼 Consulting

📣 Marketing

📦 Logistics

Engenheiro de Dados Sênior construindo pipelines medalhão no Databricks e Azure para cliente automotivo global. Garantindo governança, qualidade e CI/CD para habilitar BI e Data Science.

🗣️🇧🇷🇵🇹 Portuguese Required

Azure

PySpark

Python

SQL

Unity