Senior Data Platform Engineer

Job not on LinkedIn

🔥 49 minutes ago

🌐 Kazakhstan, India – Remote

infoinfo

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 21%

infoinfo
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Mirantis

Mirantis

501 - 1000 employees

💼 Consulting

🏥 Healthcare

📦 Logistics

Consulting • Healthcare • Logistics

Mirantis is a company that specializes in container management and cloud infrastructure solutions. It offers a range of products, including Mirantis Kubernetes Engine (MKE), Mirantis OpenStack for Kubernetes (MOSK), and Mirantis Container Cloud (MCC), which provide enterprise-level Kubernetes and container management platforms. Mirantis also develops tools for secure software supply chains, such as the Mirantis Container Runtime (MCR) and Mirantis Secure Registry (MSR). As an advocate for open source technologies, Mirantis supports various projects and provides resources like Lens Desktop, a popular Kubernetes IDE, and technical support for enterprises adopting cloud-native technologies. Their solutions cater to sectors such as public services, financial services, and broader SaaS and technology services industries.

📋 Description

• Design, deploy, and operate the production streaming platform on Kubernetes • Manage cluster lifecycle, topics, partitioning, retention strategy, capacity planning, and upgrades • Build and maintain change-data-capture and connector pipelines between operational databases, the streaming layer, and analytical stores • Own schema governance, including schema registry, compatibility rules, and versioning • Develop custom connectors, transformations, and stream-processing logic in Java or Go • Build self-service onboarding for topics, schemas, and access through infrastructure as code • Automate the platform with Terraform and GitOps • Instrument the pipeline with metrics, lag and throughput monitoring, alerting, and dashboards • Enforce security and multi-tenant isolation across the streaming layer • Guarantee ordering, idempotency, exactly-once delivery where required, replay, and disaster recovery • Partner with backend and SRE teams on event schema design, producer patterns, and failure modes • Participate in on-call for the platform • Mentor engineers on streaming architecture and contribute through design reviews and documentation

🎯 Requirements

• 10+ years in software, data, or platform engineering, including deep hands-on ownership of a production event-streaming platform • Expert-level Apache Kafka (or Confluent Platform/Cloud), including administration, tuning, troubleshooting, and capacity management at production scale • Strong Kafka Connect and CDC experience, including Debezium, JDBC, and custom connector or transformation development • Proven schema-registry practice and compatibility management across many independent producers and consumers • Solid programming ability in Java, Python, or Go • Strong SQL and relational database knowledge, including replication and CDC mechanics • Kubernetes fluency, including deploying, operating, and debugging stateful workloads • Infrastructure as code discipline using Terraform or equivalent and CI/CD pipeline ownership • Clear written English for design documents, runbooks, and asynchronous review across global time zones • Apache Kafka or Confluent, Kafka Connect, Schema Registry, and stream processing • CDC tooling such as Debezium or equivalent, connector development, and pipelines into analytical stores • Kubernetes, Docker, and Helm-packaged workloads in production • Terraform, CI/CD, and GitOps practice • PostgreSQL at scale, plus at least one cloud data warehouse or search store • AWS or GCP, including networking, IAM, and managed Kubernetes • mTLS, OIDC/SSO, RBAC, and Prometheus/Grafana monitoring • Bachelor’s degree in Computer Science & Engineering or related field or 10 years related experience

🏖️ Benefits

• Professional development and training • Attend conferences and working groups • Company outings, happy hours, hackathons, and tech talks • Competitive compensation package with a strong benefits plan • Remote work arrangement

Apply Now

Similar Jobs

🕒 July 29

Bonapolia

11 - 50

💼 Consulting

📣 Marketing

📦 Logistics

Senior Data Engineer enhancing data infrastructure for Big Four accounting firm. Developing scalable Spark applications using cutting-edge technologies in a fully remote setting.

🇰🇿 Kazakhstan – Remote

⏰ Full Time

🟠 Senior

🚰 Data Engineer

Apache

Azure

Microservices

Pandas

Python

Spark