Senior Data Developer, Azure

🕒 May 15

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

CI&T

WebsiteLinkedInAll Job Openings

5001 - 10000 employees

Founded 1995

🤖 Artificial Intelligence

☁️ SaaS

💰 $5.5M Venture Round on 2014-04

Artificial Intelligence • Cloud Services • SaaS

CI&T is a global tech transformation specialist focusing on helping organizations navigate their technology journey. With services spanning from application modernization and cloud solutions to AI-driven data analytics and customer experience, CI&T empowers businesses to accelerate their growth and maximize operational efficiency. The company emphasizes digital product design, strategy consulting, and immersive experiences, ensuring a robust support system for enterprises in various industries.

📋 Description

• Pipeline Development: Implement ELT/ETL pipelines for ingesting, transforming, and delivering data from diverse sources, including spreadsheets, SharePoint, and relational databases, following architecture standards; • Data Platform Construction: Build and organize the layers of the Data Lake/Lakehouse (Bronze, Silver and Gold / Medallion Architecture) using optimized formats such as Delta Lake and Parquet; • Transformation and Modeling: Develop data transformations using PySpark and advanced SQL, implementing architecture-defined models in the platform's analytical layers; • Ingestion Strategies: Implement loading strategies (full load or incremental) appropriate to the volume and criticality of each data domain — focusing on efficiency for small-data contexts; • Data Quality: Implement automated data quality tests and checks within pipelines, ensuring consistency, integrity, and traceability across layers; • Cataloging and Governance: Support the cataloging and documentation of data assets with emphasis on lineage and classification, following governance guidelines defined by the Architect, establishing a unified data catalog as a central element of platform management; • Observability: Ensure observability of pipelines through logs, alerts, and proactive monitoring; • Documentation: Document models, transformations, and business rules applied in pipelines, ensuring traceability and maintainability of the solution.

🎯 Requirements

• Proven experience in Data Engineering in cloud environments; • Strong experience with PySpark for developing pipelines and data transformations on distributed platforms; • Experience with advanced SQL for queries, transformations, and analytical modeling; • Knowledge of Microsoft Azure (Azure Data Factory, ADLS Gen2 and/or Microsoft Fabric); • Experience with data formats such as Delta Lake, Parquet, or ORC; • Experience with Data Lake, Lakehouse, and Medallion Architecture; • Experience with data cataloging and lineage, including Unity Catalog (Databricks); • Preferred / Nice to Have: • Experience with Databricks and/or Snowflake as a data processing platform; • Familiarity with Microsoft Fabric (Lakehouses, Notebooks, Pipelines or Dataflows); • Experience with Microsoft Purview for data cataloging and lineage; • Knowledge of dbt for transformations and data quality testing; • Experience orchestrating pipelines with Apache Airflow or Prefect; • DP-700 certification or equivalent; • Development best practices: version control with Git, automated testing, documentation, and CI/CD; • Familiarity with Gen AI and autonomous agents applied to data.

🏖️ Benefits

• Health and dental insurance; • Meal and food allowance; • Childcare assistance; • Extended parental leave; • Partnerships with gyms and health and wellness professionals via Wellhub (Gympass) / TotalPass; • Profit Sharing (PLR); • Life insurance; • Continuous learning platform (CI&T University); • Discount club; • Free online platform dedicated to promoting physical and mental health and wellbeing; • Expectant parent and responsible parenthood course; • Partnerships with online course platforms; • Language learning platform; • And many others