Senior Data Platform Engineer

Job not on LinkedIn

🔥 18 hours ago

🇵🇱 Poland – Remote

💵 zł180 - zł200 / hour

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 1%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.Why this score:

• Open for 1 day.
• Jobs at this company usually fill in 73 days.

Apply Now

Find Similar Remote Jobs

MARGO

WebsiteLinkedInAll Job Openings

201 - 500 employees

Founded 2005

💼 Consulting

🛡️ Insurance

📦 Logistics

Consulting • Insurance • Logistics

MARGO is a digital consulting firm specializing in high-complexity IT missions across various sectors. As data, AI, and digital experts, MARGO partners with ambitious clients to drive progress through digital transformation. With a focus on industries such as finance, insurance, energy, and technology, MARGO provides expertise in artificial intelligence, cloud transformation, data architecture, and software engineering.

📋 Description

• Own the Apache Airflow platform, including environments, deployment, upgrades, configuration, connections, variables, pools, and DAG standards • Migrate orchestration from Azure Data Factory to Airflow and evolve the Metadata-Driven Orchestration Framework • Ensure Airflow reliability and observability through SLAs, alerting, retries, backfills, health monitoring, and failure ownership • Manage Azure resources with Terraform, including Databricks workspaces, Data Lake Storage, Data Factory, Key Vault, networking, and supporting services • Own secrets, identity, and access management using Key Vault, service principals, managed identities, Azure RBAC, Entra ID, and Unity Catalog • Own Azure DevOps repositories, CI/CD pipelines, branch policies, multi-environment promotion, deployment validation, and Terraform state • Track Azure resource cost and governance through tagging, budgets, right-sizing, and cost attribution • Contribute to the Data Catalog, Data Quality Framework, and platform-wide lineage • Drive observability for debuggable, alert-driven pipelines with clear failure ownership • Operate Databricks and Unity Catalog, including cluster and job policies, Auto Loader ingestion, and workload performance and cost optimization • Participate in architecture reviews and technical decision-making • Define and promote engineering standards through code reviews and design reviews • Collaborate with Architects, Product Owners, and data engineers on data product technical maturation • Build and maintain developer tooling and automation, including AI-assisted engineering workflows • Provide second-line support to the Run/Operations team • Troubleshoot platform incidents, lead root cause analyses and post-mortems • Ensure handover, documentation, and operational readiness of platform changes • Improve runbooks, monitoring, and operational processes

🎯 Requirements

• 6+ years of experience in data engineering, with significant time on platform or infrastructure topics • Strong technical expertise with Python and SQL (advanced), including PySpark and Delta Lake semantics • Deep hands-on experience with Apache Airflow in production: DAG design, deployment, operations, upgrades, and orchestration of Databricks and ADF workloads • Hands-on experience with Azure resource management: Key Vault, managed identities and service principals, secret management • Experience with access management: Azure RBAC, Entra ID, Unity Catalog permissions • Experience with Azure DevOps (repos, pipelines, service connections, environments) and CI/CD for data platforms • Experience with ADLS, networking and security basics, Azure Data Factory • Experience with Infrastructure as Code (Terraform) and multi-environment promotion • Hands-on experience with Databricks and Unity Catalog (compute, jobs, governance) • Experience with observability and monitoring, alerting and incident management • Solid understanding of Data Lakehouse architecture, Medallion architecture and metadata-driven architecture • Awareness of cost management and performance • Strong problem-solving and analytical thinking • Ability to work in cross-functional teams and influence without authority • Ownership mindset and attention to detail • Good communication skills with technical and business stakeholders • Role requires permanent contract or B2B arrangement

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume