Master Data Developer, Databricks

πŸ•’ October 28

πŸ‡¨πŸ‡΄ Colombia – Remote

⏰ Full Time

🟠 Senior

πŸ–₯ Software Engineer

Where this job comes from

Posted on CI&T's careers page β†—CI&T's careers page, not through a job board

First seen by Remote Rocketship October 28

Still open on CI&T's site. Checked 4 hours ago.

Apply Now
Logo of CI&T

CI&T

5001 - 10000 employees

Founded 1995

πŸ’Ό Consulting

πŸ₯ Healthcare

πŸ“£ Marketing

πŸ’° $5.5M Venture Round on 2014-04

Consulting β€’ Healthcare β€’ Marketing

CI&T is a global tech transformation specialist focusing on helping organizations navigate their technology journey. With services spanning from application modernization and cloud solutions to AI-driven data analytics and customer experience, CI&T empowers businesses to accelerate their growth and maximize operational efficiency. The company emphasizes digital product design, strategy consulting, and immersive experiences, ensuring a robust support system for enterprises in various industries.

πŸ“‹ Description

β€’ Build, optimize, and maintain scalable data pipelines and ETL/ELT processes for analytics and business intelligence β€’ Implement data architectures, including data lakes, warehouses, and integration layers β€’ Implement data quality checks, validation processes, and monitoring systems β€’ Develop and maintain integrations between data sources, third-party tools, and analytics platforms β€’ Collaborate with Data & Analytics Managers and business stakeholders to understand requirements and deliver technical solutions β€’ Monitor and optimize data pipeline performance, query efficiency, and storage costs β€’ Create and maintain technical documentation for data architectures, pipelines, and processes β€’ Implement security best practices and ensure compliance with data privacy regulations β€’ Leverage AI tools and automation to enhance data engineering workflows and productivity

🎯 Requirements

β€’ Hands-on Databricks migration with the databricks/migrate tool, including notebooks, jobs, clusters, secrets, and ACLs β€’ Unity Catalog to Glue Catalog migration experience β€’ Notebook and job migration, including DAG pipelines and DLT pipelines β€’ Storage path refactoring from /mnt/ and DBFS references to S3-backed locations β€’ Data migration from Delta Lake format to Iceberg format on S3, including Delta tables, raw files, and incremental sync β€’ Streaming experience with Auto Loader / DLT checkpoint re-bootstrap and event_id deduplication β€’ Validation using row counts, checksums, sample queries, and ETL runtime comparison β€’ Recreate secret scopes in AWS Secrets Manager β€’ Experience with AWS services: S3, Glue, Secrets Manager, IAM basics, Athena, Lake Formation, and EMR β€’ Programming and query languages: Spark SQL, PySpark, Java, Python, and Scala β€’ Agile pod delivery, including daily ticket updates, standups, and code review

πŸ–οΈ Benefits

β€’ Premium Healthcare β€’ Meal voucher β€’ Maternity and Parental leaves β€’ Mobile services subsidy β€’ Sick pay-Life insurance β€’ CI&T University β€’ Colombian Holidays β€’ Paid Vacations

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ September 9

Huzzle.com

51 - 200

🎯 Recruiter

πŸ‘₯ HR Tech

☁️ SaaS

Founding Engineer building a 0β†’1 financial platform for Huzzle, which connects talent with leading startups and technology companies. Architecting banking, payments, ledger, compliance, and money-movement infrastructure.

πŸ‡¨πŸ‡΄ Colombia – Remote

πŸ’° $1.8M Pre Seed Round - Huzzle on 2024-04

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ–₯ Software Engineer

πŸ•’ July 30

Softgic

51 - 200

πŸ’Ό Consulting

🀝 B2B

πŸ€– Artificial Intelligence

Senior Mobile Developer leading the evolution of a mobile application for outdoor enthusiasts. Responsible for both iOS and Android development with a focus on intelligent features.

πŸ‡¨πŸ‡΄ Colombia – Remote

⏰ Full Time

🟠 Senior

πŸ–₯ Software Engineer

πŸ•’ June 18

SQDM

201 - 500

πŸ’Ό Consulting

πŸ›‘οΈ Insurance

πŸ“¦ Logistics

Senior Power BI Developer focusing on turning data into strategic insights for decision-making. Involved in developing dashboards and analytical solutions for business intelligence.

πŸ‡¨πŸ‡΄ Colombia – Remote

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ–₯ Software Engineer

πŸ—£οΈπŸ‡ͺπŸ‡Έ Spanish Required

πŸ•’ May 21

SQDM

201 - 500

πŸ’Ό Consulting

πŸ›‘οΈ Insurance

πŸ“¦ Logistics

πŸ‡¨πŸ‡΄ Colombia – Remote

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ–₯ Software Engineer

πŸ—£οΈπŸ‡ͺπŸ‡Έ Spanish Required

πŸ•’ April 7

SQDM

201 - 500

πŸ’Ό Consulting

πŸ›‘οΈ Insurance

πŸ“¦ Logistics

Senior MuleSoft Developer at SQDM designing, building, and deploying cloud integrations. Collaborating with technical teams to deliver scalable solutions with API-led connectivity.

πŸ‡¨πŸ‡΄ Colombia – Remote

πŸ’΅ $20 / hour

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ–₯ Software Engineer

πŸ—£οΈπŸ‡ͺπŸ‡Έ Spanish Required

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok