Senior Data Engineer

Job not on LinkedIn

September 22

Apply Now

Receive Emails with Similar Jobs

paiqo

WebsiteLinkedInAll Job Openings

We help our customers digitize their businesses in the field of data platform and artificial intelligence.

11 - 50 employees

📋 Description

• Design end-to-end architectures for data platforms, establish self-service platforms and implement governance and cost optimization standards • Select Azure technologies, conduct code reviews and coach the team • Develop end-to-end data solutions on Azure from source system connection to processing and provision of data for BI/AI applications • Select and integrate appropriate technologies (e.g. streaming with Kafka/Event Hubs, storage in Azure Data Lake/Azure SQL, processing with Spark) • Implement best practices for coding, testing and monitoring data pipelines to ensure reliability and scalability • Establish automated CI/CD workflows and monitor operational processes (monitoring, alerting) • Work closely with customers and business stakeholders to gather requirements and translate them into technical solutions • Participate in pre-sales and consulting activities

🎯 Requirements

• 5+ years of experience in data engineering / data platform development, including extensive practice on Microsoft Azure • Knowledge of data architectures, distributed data processing systems and cloud services (Azure Data Factory, MS Fabric, Databricks, Event Hubs etc.) • Experience in data security and governance - knows data protection requirements and implements access authorizations, encryption and compliance conformity • Proven ability to achieve performance and cost optimization with large data volumes • Proficient in DevOps methods: continuous delivery of data pipelines, infrastructure-as-code (e.g. Terraform/Bicep) and containerized deployments • Strategic thinking & consulting: Ability to translate business requirements into data architectures and advise clients • Leadership skills to technically lead a team and clear communication skills with customers (including non-technical contacts) • Very good knowledge of German and English