Senior Data Engineer

Job not on LinkedIn

November 15

Apply Now

Receive Emails with Similar Jobs

Runtalent

WebsiteLinkedInAll Job Openings

B2B • HR Tech • SaaS

Runtalent is a technology services company that specializes in the allocation of qualified professionals across various tech platforms for project needs. They focus on agile squads and managed services, ensuring operational efficiency and project success. With over 20 years in the market, Runtalent has established a strong talent pool and collaborates with multiple industries including finance, healthcare, and entertainment to provide tailored solutions for each client.

501 - 1000 employees

Founded 2003

🤝 B2B

👥 HR Tech

☁️ SaaS

📋 Description

• Design and implement data ingestion, transformation and provisioning pipelines using Azure Data Factory (ADF), Azure Databricks (ADB) and Azure Synapse Analytics. • Model and structure Data Lakes and Data Warehouses on Azure, ensuring governance, versioning and compliance. • Integrate multiple data sources (on-premises, SaaS, APIs, relational and non-relational databases) efficiently and securely. • Develop high-performance ETL/ELT solutions, applying engineering best practices and code versioning. • Ensure optimized use of Azure Storage Accounts, managing costs, performance and security policies. • Create and maintain metadata structures, data catalogs and data lineage mechanisms. • Collaborate with Analytics, Data Science and Business teams to provide reliable, high-quality data. • Define technical standards, frameworks and best practices for the corporate data environment. • Support the evolution of the data architecture, proposing innovations and continuous improvements in performance and governance.

🎯 Requirements

• Strong expertise in Microsoft Azure, especially Azure Data Lake, Azure Storage Account, Azure Databricks (ADB), Azure Data Factory (ADF) and Azure Synapse Analytics. • Proficiency in SQL (tuning, modeling, stored procedures), Python (PySpark, pandas, Airflow) and Spark (partitions, performance tuning, Delta Lake). • Solid experience building pipelines, incremental ingestion, orchestration and monitoring of data flows in ADF/Databricks. • Knowledge of Azure Active Directory, Role-Based Access Control (RBAC), Data Masking, Encryption at Rest & in Transit and Azure Key Vault. • Experience with Data Vault, Dimensional Modeling (Kimball), Lakehouse Architecture and query optimization in distributed environments. • Use of Git, Azure DevOps, CI/CD pipelines, automated testing and continuous integration for data deployments. • Implementation of automated monitoring, alerts, execution logs and data observability practices. • Ability to design scalable and cost-effective solutions, with a focus on security, performance and governance.

🏖️ Benefits

• Remote work