Lead Data Engineer

🔥 21 hours ago

🇧🇷 Brazil – Remote

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 10%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Experian

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1996

💼 Consulting

📣 Marketing

📦 Logistics

Consulting • Marketing • Logistics

Experian is a global leader in digital experience, technology, and transformation. They partner with recognized brands to enhance customer understanding, innovate product strategies, and implement agile technology solutions. With a focus on delivering superior customer experiences through AI, cloud architecture, and project management, Experian helps businesses streamline their operations and achieve their objectives effectively.

📋 Description

• Design, implement, and evolve a petabyte-scale AWS data platform • Build and optimize scalable data pipelines using JVM languages, Spark, Python, and cloud-native services • Act as a principal-level technical leader by mentoring engineers, conducting code reviews, and promoting best practices • Contribute to architectural and design decisions with architects, product owners, and engineering leadership • Plan and deliver complex technical initiatives within agile value-stream teams • Ensure operational readiness through coding standards, testing practices, monitoring strategies, and release procedures • Support production deployments and maintain platform stability • Explore and adopt GraphQL integrations, vector databases, and AI/LLM-based techniques

🎯 Requirements

• Expert-level software and data engineering experience in large-scale data platforms • Deep experience building petabyte-scale systems using Java-based languages such as Scala and Apache Spark • Strong expertise across the AWS data ecosystem, including Glue, S3, Athena, Managed Airflow, and Iceberg • Advanced understanding of distributed systems and highly parallelized workloads • Strong skills in query optimization, data partitioning, and efficient storage patterns • AWS cloud ecosystem mastery; Azure/GCP are pluses • Experience influencing long-term architecture and platform design • Excellent code review, mentorship, and technical leadership capabilities • Hands-on experience working in agile environments and collaborating across multiple engineering teams • Strong version control and multi-repo collaboration skills using Git, GitHub, and Bitbucket • Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience • Relevant experience • Advanced English • Availability to travel to São Carlos/SP when needed • Experience with DBT or modern transformation frameworks • Knowledge of concurrent and parallel programming • Familiarity with Python, Angular, and TypeScript • Experience with vector databases such as pgvector and Redis vector fields • Practical experience applying AI/LLM techniques to data platforms, data access, or software quality

🏖️ Benefits

• Inclusive recruitment initiatives • Professional development initiatives • Affinity groups supporting underrepresented groups: ExperianPride, Ubuntu, Women in Experian, Aspire, and Connecting Generations