Senior Data Engineer, Airflow

🕒 February 13

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Capgemini

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1967

🏢 Enterprise

🤖 Artificial Intelligence

🔒 Cybersecurity

Enterprise • Artificial Intelligence • Cybersecurity

Capgemini is a global leader in partnering with businesses to transform and manage their operations by harnessing the power of technology. With expertise across a wide array of industries such as aerospace, automotive, banking, and healthcare, Capgemini provides a constantly evolving portfolio of services to meet the ever-changing needs of their clients. Their offerings include cloud, cybersecurity, data and artificial intelligence, and enterprise management, among others. Capgemini also emphasizes innovation and sustainability, helping companies achieve digital transformation while promoting environmental and social responsibility. Additionally, Capgemini provides career opportunities across various levels and professions, encouraging innovation and diversity in its workforce.

📋 Description

• Build and maintain automated data workflows and orchestrations using Apache Airflow • Build automation processes using Copilot to generate Airflow DAGs • Implement at least two major end-to-end data pipeline projects using Airflow • Design and optimize complex DAGs for scalability, maintainability, and reliability • Create reusable, parameterized, and modular Airflow components (operators, sensors, hooks) to streamline workflow development • Ensure effective monitoring, alerting, and logging of Airflow DAGs for quick issue resolution • Document workflows, solutions, and processes for team knowledge sharing and training • Mentor and support other team members in Airflow usage and adoption • Explain best practices, identify pros and cons, and communicate technical decisions to team members • Develop reusable frameworks, leveraging reusable concepts for efficiency and scalability • Implement and utilize reusable ecosystem components, including Python & Apache Airflow, DynamoDB, Amazon RDS • Develop reusable frameworks to enforce data governance and data quality standards • CI/CD pipeline development using re-usable frameworks and Jenkins

🎯 Requirements

• Between 4-6 years of experience in a similar role • Bachelor's degree in IT, Information systems, Computer Science or a related field • Insurance Experience (Desirable) • Fluency in English • Airflow (MUST) / Astronomer (PLUS) - Advanced (5 Years) • Python - Advanced (4-6 Years) (MUST) • Snowflake – Intermediate (MUST) • DBT - Entry Level (PLUS) • AWS Glue - Entry Level (PLUS) • DynamoDB - Intermediate • Amazon RDS - Intermediate • Jenkins - Intermediate • Work Independently • Strategic Thinking • Guide Others • Documentation • Explain best practices • Communicate Technical Decisions

🏖️ Benefits

• A competitive salary and performance-based bonuses. • Comprehensive benefits package. • Flexible work arrangements (remote and/or office-based). • You will also enjoy a dynamic and inclusive work culture within a globally renowned group. • Private Health Insurance. • Paid Time Off. • Training & Development opportunities in partnership with renowned companies.