Data Platform Engineer

🔥 0 minutes ago

🇵🇱 Poland – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

👻 Ghost score 16%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Software Mind

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 1999

🤖 Artificial Intelligence

☁️ SaaS

📡 Telecommunications

💰 Private Equity Round on 2020-12

Artificial Intelligence • SaaS • Telecommunications

Software Mind is a technology company that specializes in software development and digital transformation services. With a focus on AI and cloud solutions, the company offers a wide range of services including custom software development, mobile app development, and cloud consulting. Software Mind serves various industries such as financial services, telecom, biotech, and media, providing tailored solutions to accelerate digital transformations and business growth globally.

📋 Description

• Build and operate change-data-capture pipelines from PostgreSQL into Azure using Kafka Connect and Debezium • Configure, deploy and scale connectors end to end, including connector setup, task management, offsets, schema history and snapshot strategy • Run pipelines as stateful workloads on Kubernetes (AKS), covering configuration, secrets, networking and resource tuning • Monitor and troubleshoot the platform in production, including connector failures, task rebalances, restarts, throughput, backpressure, message-size limits, retries and recovery • Automate the platform in Python through configuration-driven onboarding, pipeline orchestration, monitoring and alerting, recovery workflows and automated testing • Integrate CDC streams with Azure Event Hubs, ADLS, Azure PostgreSQL, ADF and Databricks • Manage platform infrastructure as code so environments are reproducible and changes are reviewable • Apply data protection requirements to sensitive data flowing through pipelines, including masking, hashing, access control and retention

🎯 Requirements

• Solid commercial experience as a data or platform engineer, with hands-on work on streaming or CDC pipelines rather than batch reporting alone • Practical Kafka knowledge — topics, partitions, offsets, consumer groups and delivery semantics — including at least one Kafka Connect deployment you ran yourself • Strong SQL and PostgreSQL skills, with working knowledge of WAL, logical replication, replication slots and replication lag • Working understanding of CDC concepts: initial snapshots, inserts, updates and deletes, event ordering, at-least-once delivery, and schema evolution • Confident Python for automation and tooling — orchestration, monitoring, recovery scripts, and automated tests • Hands-on experience with Azure data services, for example Event Hubs, ADLS or Azure PostgreSQL • Comfortable working with Kubernetes as a user: deploying workloads, handling configuration and secrets, reading logs, debugging failing pods • Ability to debug a running pipeline from metrics and logs — telling throughput problems from backpressure, retries or a genuine connector failure • Production experience with Debezium specifically — snapshot strategies on large tables, schema history recovery, offset loss, and bringing connectors back after failure • Experience operating stateful workloads on AKS: StatefulSets, stable worker identity, and resource tuning under load • Infrastructure-as-code and CI/CD for data platform components (Terraform, Bicep or similar) • Hands-on work with Databricks and ADF at production scale • Hands-on experience implementing data protection controls for sensitive data — masking, hashing, access control and retention policies

🏖️ Benefits

• Flexible employment and remote work • International projects with leading global clients • International business trips • Non-corporate atmosphere • Language classes • Internal & external training • Private healthcare and insurance • Multisport card • Well-being initiatives