Senior Data Engineer (Azure)

March 14

GetInData | Part of Xebia

WebsiteLinkedInAll Job Openings

Experts dedicated to becoming the leaders in providing Big Data, Cloud, Analytics, ML/AI/BI services.

Big data • Hadoop • NoSQL • Spark • Kafka

51 - 200

Description

• A Data Engineer's role involves the design, construction, and upkeep of data architecture, tools, and procedures facilitating an organization's collection, storage, manipulation, and analysis of substantial data volumes. • This position involves erecting data platforms atop commonly provided infrastructure and establishing a streamlined path for Analytics Engineers who rely on the system. • Working together with Platform Engineers to assess and choose the most suitable technologies and tools for the project • Development and committing of new functionalities and open-source tools • Executing intricate data intake procedures • Implementing and enacting policies in line with the company's strategic plans regarding utilized technologies, work organization, etc. • Ensuring compliance with industry standards and regulations in terms of security, data privacy applied in the data processing layer • Conducting training and knowledge-sharing

Requirements

• Proficiency in a programming language like Python / Scala or Java • Knowledge of Lakehouse platforms - Databricks • Experience working with messaging systems - Kafka • Familiarity with Version Control Systems, particularly GIT • Experience as a programmer and knowledge of software engineering, good principles, practices, and solutions • Extensive experience in Microsoft Azure • Knowledge of at least one orchestration and scheduling tool, for example, Airflow, Azure Data Factory, Prefect, Dagster • Familiarity with DevOps practices and tools, including Docker, Terraform, CI/CD, Azure DevOps

Benefits

• Salary: 160 - 200 PLN net + VAT/h B2B (depending on knowledge and experience) • 100% remote work • Flexible working hours • Possibility to work from the office located in the heart of Warsaw • Opportunity to learn and develop with the best Big Data experts • International projects • Possibility of conducting workshops and training • Certifications • Co-financing sport card • Co-financing health care • All equipment needed for work