[Job-25825] Data Tech Lead - Databricks, Brazil

Vaga não está no LinkedIn

Novembro 10

Candidatar-se

Receber Emails com Vagas Similares

CI&T

SiteLinkedInTodas as Vagas

Artificial Intelligence • Cloud Services • SaaS

CI&T é especialista global em transformação tecnológica, ajudando organizações a trilhar sua jornada tecnológica. Com serviços que vão de modernização de aplicações e soluções em cloud a data analytics com IA e experiência do cliente, a CI&T capacita negócios a acelerar o crescimento e maximizar a eficiência operacional. A empresa enfatiza design de produtos digitais, consultoria estratégica e experiências imersivas, assegurando um suporte robusto para empresas de diversos setores.

5001 - 10000 funcionários

Fundada em 1995

🤖 Inteligência Artificial

☁️ SaaS

💰 $5.500.000 Venture Round em 2014-04

Descrição

• Architect and Design a hub-and-spoke data platform on Databricks to integrate structured, semi-structured, and unstructured data from multiple sources • Enable Advanced Analytics & Real-Time Use Cases such as personalization, customer 360, recommendation systems, and marketing attribution • Implement DataOps Best Practices, including CI/CD pipelines, version-controlled workflows, automated testing, data quality monitoring, and observability • Define and Enforce Data Contracts to ensure schema consistency and reliable data exchange between producers and consumers • Optimize Data Processing using Databricks Delta Lake, Spark, and streaming technologies for both batch and real-time pipelines • Integrate with Cloud-Native Ecosystems (AWS/Azure/GCP) for scalable storage, compute, security, and orchestration • Collaborate Across Teams including business stakeholders, analytics, ML, and engineering teams to align data architecture with business goals • Ensure Security and Compliance with industry standards (e.g., GDPR, CCPA) for sensitive retail and customer data

🎯 Requisitos

• Expertise in Databricks (Delta Lake, Spark, Databricks SQL, Unity Catalog, MLflow) • Strong background in data architecture and design of large-scale, distributed systems • Proven experience building data pipelines (batch and streaming) with technologies like Delta Live Tables, Spark Structured Streaming, Kafka, Event Hubs, or Kinesis • Solid understanding of DataOps practices: CI/CD for data workflows, testing frameworks, monitoring, and observability tools • Proficiency in SQL and Python (PySpark) • Hands-on experience with cloud platforms (AWS, Azure, or GCP) including storage, networking, IAM, and security best practices • Knowledge of data governance, lineage, and cataloging solutions (e.g., Unity Catalog, Collibra, Alation) • Ability to integrate APIs, third-party systems, and retail platforms into the data ecosystem • Advanced English is essential • Understanding of the entire business side • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field • Retail industry experience with customer data, personalization, and omnichannel analytics use cases • Experience implementing real-time decisioning systems or personalization engines • Familiarity with modern orchestration tools (Airflow, dbt, Dagster, Prefect) • Experience with data quality frameworks (Great Expectations, Deequ, Soda) • Exposure to machine learning pipelines and MLOps best practices • Excellent communication and stakeholder management skills • Certifications in Databricks, Azure Data Engineer, AWS Big Data, or GCP Data Engineering.

🏖️ Benefícios

• Health and dental insurance • Meal and food allowance • Childcare assistance • Extended paternity leave • Partnership with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass • Profit Sharing and Results Participation (PLR) • Life insurance • Continuous learning platform (CI&T University) • Discount club • Free online platform dedicated to physical, mental, and overall well-being • Pregnancy and responsible parenting course • Partnerships with online learning platforms • Language learning platform • And many more!