Lead Data Platform Engineer

🔥 2 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Experian

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1996

💼 Consulting

📣 Marketing

📦 Logistics

Consulting • Marketing • Logistics

Experian is a global leader in digital experience, technology, and transformation. They partner with recognized brands to enhance customer understanding, innovate product strategies, and implement agile technology solutions. With a focus on delivering superior customer experiences through AI, cloud architecture, and project management, Experian helps businesses streamline their operations and achieve their objectives effectively.

📋 Description

• Design, implement, and evolve a petabyte-scale AWS data platform • Build and optimize scalable data pipelines using JVM languages, Spark, Python, and cloud-native services • Act as a principal-level technical leader by mentoring engineers, conducting code reviews, and promoting best practices • Contribute to architectural and design decisions with architects, product owners, and engineering leadership • Plan and deliver complex technical initiatives within agile value-stream teams • Ensure operational readiness through coding standards, testing, monitoring, and release procedures • Support production deployments and maintain platform stability • Explore and adopt GraphQL integrations, vector databases, and AI/LLM-based techniques

🎯 Requirements

• Expert-level software and data engineering experience in large-scale data platforms • Deep experience building petabyte-scale systems using Java-based languages such as Scala and Apache Spark • Strong expertise across AWS data services, including Glue, S3, Athena, Managed Airflow, and Iceberg • Advanced understanding of distributed systems and highly parallelized workloads • Strong skills in query optimization, data partitioning, and efficient storage patterns • AWS cloud expertise; Azure/GCP are pluses • Experience influencing long-term architecture and platform design • Excellent code review, mentorship, and technical leadership capabilities • Hands-on experience in agile environments and collaboration across multiple engineering teams • Strong version control and multi-repo collaboration skills with Git, GitHub, and Bitbucket • Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience • Advanced English • Availability to travel to São Carlos/SP when needed • Nice to have: DBT or modern transformation frameworks • Nice to have: Concurrent and parallel programming knowledge • Nice to have: Python, Angular, and TypeScript • Nice to have: Vector database experience, including pgvector and Redis vector fields • Nice to have: Practical AI/LLM experience applied to data platforms, data access, or software quality

🏖️ Benefits

• Remote work • Inclusive recruitment and professional development initiatives • Affinity groups supporting underrepresented groups: ExperianPride, Ubuntu, Women in Experian, Aspire, and Connecting Generations