Senior Data Engineer – All Genders

🔥 14 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Kaufland e-commerce

WebsiteLinkedInAll Job Openings

501 - 1000 employees

Founded 2015

🛍️ eCommerce

🏪 Marketplace

🤝 B2B

eCommerce • Marketplace • B2B

Kaufland e-commerce is the technology arm and employer brand powering Kaufland’s international online marketplaces. It builds and operates the Kaufland online marketplaces and Kaufland Global Marketplace (KGM) — a B2B all‑in‑one seller solution — and develops related digital products (for example the Kaufland app and Kaufland Card). As an independent tech company collaborating with Kaufland retail, KEC focuses on marketplace platform, product and engineering teams and employs 800+ people across multiple German locations and remote to serve millions of customers and thousands of merchants across Europe.

📋 Description

• Design, develop, and maintain our streaming and CDC backbone (Apache Kafka, Debezium, Schema Registry, BigQuery sinks) and our in-house workflow management platform Navarch, running on Kubernetes • Lead architectural initiatives across the platform end-to-end — from concept to production — covering streaming, orchestration, the data warehouse, and the cross-cutting observability layer • Operate and evolve our BigQuery multi-project setup, defining access management, partitioning, slot strategy, and cost-aware design patterns • Define how the platform supports domain analysts who deliver their own pipelines — clear ownership boundaries, quality safeguards, and reduced hand-off friction between producers and the platform team • Build and maintain observability across the data platform (Datadog, Slack-native alerting, cost dashboards) and manage our CI/CD pipelines on our self-hosted GitLab instance • Manage BigQuery and Kafka costs at platform scale — FinOps in practice • Provide senior input into architectural decisions across the platform — design reviews, merge-request reviews, and multi-quarter initiatives the team runs

🎯 Requirements

• Several years of senior-level data engineering experience, demonstrated by independent ownership of production systems — running on-call, shipping cross-component changes, and influencing architecture without extensive process scaffolding • Strong problem-solving skills with proven ability to troubleshoot complex, cross-component issues (schema evolution, broker lag, query performance, cost anomalies) • Professional software engineering experience with Python and a solid command of SQL on cloud data warehouses — partitioning, clustering, query cost, idempotency • Strong experience with object-oriented programming and software design patterns, applied to data engineering use cases • Hands-on experience with at least four of the following technologies: • Message brokers, ideally Apache Kafka (broker operations, Schema Registry, KRaft) • Change Data Capture, ideally Debezium • Orchestration tools (in-house, Airflow, Dagster or similar) • Public cloud providers, ideally Google Cloud Platform • Container orchestration, ideally Kubernetes (Helm, operators, KEDA/VPA) • Infrastructure as Code, ideally Terraform and/or Ansible • Data modeling and transformation, ideally dbt or comparable tools • Able to articulate trade-offs made in past decisions — batch vs. stream, build vs. buy, latency vs. cost, isolation vs. coupling — with concrete metrics from your own work • Thrive in a Kanban-style, low-process environment where senior engineers organize their own work and rotate triage weekly • Fluent in English (C1) and enjoy working in a dynamic, international environment

🏖️ Benefits

• Create your own work–life balance: Choose between remote work (within Germany) or working from one of our locations in Cologne, Darmstadt, Düsseldorf, or Berlin • Relocation support: We offer an attractive relocation package for candidates moving to Germany • Fitness benefits: Urban Sports Club and RSG Group fitness studio discounts for swimming, yoga, and more • Mental well-being: Access to offerings like Instahelp, a digital platform for online psychological counseling • Vacation & sabbatical: 30 days of vacation per year and the option to take a sabbatical after a qualifying period with the company • Pluxee restaurant vouchers: Option to purchase Pluxee vouchers through us and benefit from tax-advantaged meal allowances • Deutschlandticket subsidy: We subsidize your public transport season ticket for greater mobility • Employee discount: Monthly coupon for Kaufland.de • Choice of operating system: MacOS or Ubuntu Linux — your choice • Professional development: Online language programs, diverse in-house training, automated 360-degree feedback, and coverage for relevant conferences, training, and approved team workshops to support growth