Data Tech Lead – Databricks

Job not on LinkedIn

November 10

Apply Now

Receive Emails with Similar Jobs

CI&T

WebsiteLinkedInAll Job Openings

Artificial Intelligence • Cloud Services • SaaS

CI&T is a global tech transformation specialist focusing on helping organizations navigate their technology journey. With services spanning from application modernization and cloud solutions to AI-driven data analytics and customer experience, CI&T empowers businesses to accelerate their growth and maximize operational efficiency. The company emphasizes digital product design, strategy consulting, and immersive experiences, ensuring a robust support system for enterprises in various industries.

5001 - 10000 employees

Founded 1995

🤖 Artificial Intelligence

☁️ SaaS

💰 $5.5M Venture Round on 2014-04

📋 Description

• Architect and design a hub-and-spoke data platform on Databricks to integrate structured, semi-structured, and unstructured data from multiple sources • Enable advanced analytics and real-time use cases such as personalization, customer 360, recommendation systems, and marketing attribution • Implement DataOps best practices, including CI/CD pipelines, version-controlled workflows, automated testing, data quality monitoring, and observability • Define and enforce data contracts to ensure schema consistency and reliable data exchange between producers and consumers • Optimize data processing using Databricks Delta Lake, Spark, and streaming technologies for both batch and real-time pipelines • Integrate with cloud-native ecosystems (AWS, Azure, GCP) for scalable storage, compute, security, and orchestration • Collaborate across teams, including business stakeholders, analytics, ML, and engineering teams, to align data architecture with business goals • Ensure security and compliance with industry standards (e.g., GDPR, CCPA) for sensitive retail and customer data

🎯 Requirements

• Expertise in Databricks (Delta Lake, Spark, Databricks SQL, Unity Catalog, MLflow) • Strong background in data architecture and designing large-scale, distributed systems • Proven experience building data pipelines (batch and streaming) with technologies like Delta Live Tables, Spark Structured Streaming, Kafka, Event Hubs, or Kinesis • Solid understanding of DataOps practices: CI/CD for data workflows, testing frameworks, monitoring, and observability tools • Proficiency in SQL and Python (PySpark) • Hands-on experience with cloud platforms (AWS, Azure, or GCP), including storage, networking, IAM, and security best practices • Knowledge of data governance, lineage, and cataloging solutions (e.g., Unity Catalog, Collibra, Alation) • Ability to integrate APIs, third-party systems, and retail platforms into the data ecosystem • Advanced English is essential • Understanding of the business side of operations • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field • Retail industry experience with customer data, personalization, and omnichannel analytics use cases • Experience implementing real-time decisioning systems or personalization engines • Familiarity with modern orchestration tools (Airflow, dbt, Dagster, Prefect) • Experience with data quality frameworks (Great Expectations, Deequ, Soda) • Exposure to machine learning pipelines and MLOps best practices • Excellent communication and stakeholder management skills • Certifications in Databricks, Azure Data Engineer, AWS Big Data, or GCP Data Engineering

🏖️ Benefits

• Health and dental insurance • Meal and food allowance • Childcare assistance • Extended paternity leave • Partnerships with gyms and wellness professionals via Wellhub (Gympass) / TotalPass • Profit sharing and results participation (PLR) • Life insurance • Continuous learning platform (CI&T University) • Employee discount club • Free online platform dedicated to physical, mental, and overall well-being • Pregnancy and responsible parenting course • Partnerships with online learning platforms • Language learning platform • And many more!