Azure Data Engineer

🔥 18 hours ago

🇨🇴 Colombia – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

👻 Ghost score 12%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Capgemini

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1967

💼 Consulting

🏥 Healthcare

📦 Logistics

Consulting • Healthcare • Logistics

Capgemini is a global leader in partnering with businesses to transform and manage their operations by harnessing the power of technology. With expertise across a wide array of industries such as aerospace, automotive, banking, and healthcare, Capgemini provides a constantly evolving portfolio of services to meet the ever-changing needs of their clients. Their offerings include cloud, cybersecurity, data and artificial intelligence, and enterprise management, among others. Capgemini also emphasizes innovation and sustainability, helping companies achieve digital transformation while promoting environmental and social responsibility. Additionally, Capgemini provides career opportunities across various levels and professions, encouraging innovation and diversity in its workforce.

📋 Description

• Design, develop, and maintain scalable, high-performance data pipelines • Build ETL/ELT processes using Python, PySpark, SQL, Azure Databricks, and Azure Data Factory • Implement integration mechanisms for structured and unstructured data from multiple sources • Develop storage and processing solutions based on Data Lake and Lakehouse architecture • Ensure data quality, consistency, security, and availability • Optimize distributed processing workflows for large volumes of data • Implement data governance, monitoring, and observability standards • Design and implement solutions using Azure Databricks, Azure Data Factory, Azure Functions, Azure Storage Accounts, Azure Key Vault, and Azure Logic Apps • Automate deployments via CI/CD pipelines using Azure DevOps • Monitor and resolve incidents related to data processes in production environments • Apply security and access management best practices in cloud environments • Implement secure authentication, authorization, and secret management mechanisms • Collaborate with Data Science teams to prepare, transform, and make data available for analytical models • Participate in Machine Learning, Artificial Intelligence, and NLP initiatives • Implement and support data pipelines for forecasting and predictive analytics models

🎯 Requirements

• Bachelor’s degree in systems engineering, Computer Science, Software Engineering, Data Science, or a related field • Python, PySpark, FastAPI, and PyTest • Microsoft Azure: Azure Databricks (Databricks Notebooks, Databricks Workflows), Azure Data Factory, Azure Functions, Azure Key Vault, Azure Storage Accounts, Azure Logic Apps, and Azure DevOps • REST APIs • SQL • Git • Desirable: Web Scraping • Desirable: Microsoft Excel for exploratory analysis and data validation • Knowledge of data and analytics • Knowledge of modern data architectures • Knowledge of massive data processing and distributed computing • Knowledge of data warehousing and data lakes • Knowledge of Machine Learning Engineering fundamentals • Knowledge of Business Intelligence and enterprise analytics • Knowledge of forecasting and time-series analysis • Knowledge of credit and financial risk modeling • Knowledge of financial analysis and performance metrics • Knowledge of cash flow analysis and modeling • Experience working with Agile methodologies and Jira