Senior Data Engineer – Azure Databricks Platform

🔥 8 minutes ago

🇬🇧 United Kingdom – Remote

⏰ Full Time

🟠 Senior

☁️ Cloud Engineer

🇬🇧 UK Skilled Worker Visa Sponsor

This company has sponsored UK Skilled Worker visas in the past.

👻 Ghost score 12%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

EnerMech

WebsiteLinkedInAll Job Openings

10,000+ employees

💼 Consulting

📦 Logistics

🏭 Manufacturing

Consulting • Logistics • Manufacturing

EnerMech is a company that provides specialist integrated mechanical, electrical, instrumentation, and integrity solutions to the global energy and infrastructure sectors. With a focus on the full asset lifecycle from pre-commissioning through operations, maintenance, and ultimately decommissioning, EnerMech delivers world-class services. Headquartered in the UK, the company employs over 3,000 technical experts across 40 countries, specializing in process and pipeline services, hydraulic products, valve supply and servicing, lifting and inspection, and specialist training. EnerMech plays a significant role in major transport infrastructure projects and complex oil and gas operations, while also contributing to the energy transition through its expertise in renewables and nuclear sectors.

📋 Description

• Take technical ownership of key workstreams on EnerMech's Azure Databricks data platform across data modelling, pipeline development, Azure infrastructure, CI/CD, DevOps and DataOps • Design, build, ensure quality, and operate assigned workstreams from scoping through production deployment • Maintain integrity of bronze/silver/gold medallion data models for assigned data domains • Model, validate, document, and certify data for downstream reporting and analytics • Build and optimise Delta tables and materialized views for performance at scale • Design and implement data quality frameworks, including quarantine/error handling and validation against data contracts • Define workload-specific compute configurations balancing performance and cost • Contribute to and troubleshoot Terraform-managed infrastructure, including networking, storage, Key Vaults, Managed DevOps Pools, and Dev Centers • Own and maintain Azure DevOps build and release pipelines, variable groups/libraries, repository security, permissions, and branch policies • Support environment-level Azure configuration, subscription access, RBAC, service principal identities, and Terraform state backend management • Resolve complex platform issues and document architectural decisions • Use AI-assisted tooling for development, validating outputs against authoritative sources • Act as technical point of contact for the global EBS Team and business stakeholders • Communicate with technical and non-technical stakeholders across UK, Americas, Middle East, and Asia Pacific time zones

🎯 Requirements

• Bachelor's degree in Computer Science, Engineering, Information Systems or a related discipline, or equivalent practical experience • Typically 6+ years in data engineering, including 3+ years hands-on with Azure Databricks in production • Demonstrated ownership of medallion architecture design and data modelling • Implemented data quality frameworks and data contracts in production • Implemented PII protection (masking, tokenisation or access tiering) across environments • Platform engineering experience: diagnosing infrastructure issues, not just consuming platform services • Track record of autonomous delivery, including direct stakeholder engagement • Databricks Certified Data Engineer Associate (minimum) • Databricks Certified Data Engineer Professional (desirable) • Microsoft AZ-400: Designing and Implementing Microsoft DevOps Solutions (desirable) • Multi-environment Azure networking (VNet peering, DNS zone design, NAT Gateway) (desirable) • Migrating or standing up CI/CD pipelines, including introducing pipeline templates/standards (desirable) • Governance and identity patterns (e.g. Entra ID, RBAC scoping) (desirable) • Applying regulatory frameworks (e.g. GDPR) to data platform design (desirable) • Shared service centre or global delivery model experience, ideally in energy or industrial services (desirable)

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume