Senior Data Developer, Azure, Databricks

🔥 27 minutes ago

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

CI&T

WebsiteLinkedInAll Job Openings

5001 - 10000 employees

Founded 1995

🤖 Artificial Intelligence

☁️ SaaS

💰 $5.5M Venture Round on 2014-04

Artificial Intelligence • Cloud Services • SaaS

CI&T is a global tech transformation specialist focusing on helping organizations navigate their technology journey. With services spanning from application modernization and cloud solutions to AI-driven data analytics and customer experience, CI&T empowers businesses to accelerate their growth and maximize operational efficiency. The company emphasizes digital product design, strategy consulting, and immersive experiences, ensuring a robust support system for enterprises in various industries.

📋 Description

• Develop, maintain, and improve data pipelines using Databricks, PySpark, Python, and SQL to transform raw financial data into reliable curated datasets. • Integrate new data sources into the existing data ecosystem, helping expand the platform’s capabilities and improve business visibility. • Support financial reconciliation activities, P&L routines, and global closing processes by ensuring data consistency, accuracy, and traceability across different sources. • Process large volumes of structured and semi-structured data, optimizing transformations, storage formats, and query performance using Delta Lake and Lakehouse best practices. • Monitor, troubleshoot, and support existing pipelines, identifying issues, investigating discrepancies, and ensuring reliable daily and monthly processing. • Propose and implement better technical approaches to improve performance, scalability, maintainability, and data quality across the financial data ecosystem. • Work closely with existing data engineers, business stakeholders, finance teams, and technology teams to understand needs and deliver high-quality data solutions. • Support data governance, validation rules, auditability, documentation, and controls to ensure trustworthy and well-managed financial data. • Support initiatives involving AI models and advanced data capabilities, helping integrate AI-driven insights and automation into data workflows.

🎯 Requirements

• Strong experience with Databricks, including notebooks, jobs, workflows, clusters, and best practices for building scalable data solutions. • Proficiency in data processing using PySpark, Python, and SQL, with hands-on experience transforming raw data into curated and reliable datasets. • Experience with Delta Lake and Lakehouse architecture, including Delta tables, incremental processing, data optimization, and structured data layers. • Knowledge of Azure data ecosystem, especially Azure Data Lake Storage, data integration patterns, and cloud-based data processing. • Experience supporting financial data pipelines, preferably involving reconciliation, P&L, financial closing, or other critical business processes. • Hands-on experience maintaining and improving existing pipelines, including troubleshooting, performance tuning, documentation, and production support. • Ability to work with structured and semi-structured data, ensuring data quality, traceability, and readiness for analytical and business consumption. • Problem-solving mindset, with the ability to investigate complex data, understand root causes, and propose practical solutions in challenging data environments. • Interest or experience with AI models and advanced data capabilities, supporting the integration of AI-driven solutions into data workflows. • English proficiency for interaction with global teams, technical discussions, and documentation. • Nice to Have: • Familiarity with AI frameworks and methodologies. • Experience with advanced capabilities, such as Delta Lake optimization, Databricks Workflows and Databricks Apps or Streamlit. • Experience with data quality and observability practices, including validation rules, reconciliation checks, monitoring, logs, alerts, and pipeline execution metrics.

🏖️ Benefits

• Health and dental insurance • Meal and food allowance • Childcare assistance • Extended paternity leave • Partnership with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass; • Profit Sharing and Results Participation (PLR); • Life insurance • Continuous learning platform (CI&T University); • Discount club • Free online platform dedicated to physical, mental, and overall well-being • Pregnancy and responsible parenting course • Partnerships with online learning platforms • Language learning platform