Data Engineer – PySpark, AWS Glue

🕒 January 6

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Yadimen Consultancy Ltd

Yadimen Consultancy Ltd

51 - 200 employees

Founded 2017

💼 Consulting

💸 Finance

☁️ SaaS

Consulting • Finance • SaaS

Yadimen Consultancy Ltd. is a practitioner-led consulting practice specializing in financial services transformation across EMEA (Europe, Middle East, and Africa). The firm provides advisory and programme delivery, embeds senior specialists into client teams, and produces insights and playbooks for regulated financial institutions, system integrators, and programme directors. It focuses on regulatory change (capital, prudential, supervisory reporting like CRR3, Basel IV, FRTB), operational and ICT resilience (DORA, NIS2), platform implementations (core banking, IRM, cloud-native), payments modernization (ISO 20022 migration and post-migration data exploitation), lending platform modernization (nCino, Salesforce FS Cloud), and FS-grade customer experience and UI/UX engineering through Yadimen Studio. The practice emphasizes a hybrid AI×Human model where senior practitioners are augmented by a continuous intelligence layer to remain current on regulatory cycles and platform programmes; it delivers services locally across the UK, EU and UAE under a single governance and consulting standard.

📋 Description

• Design, develop, and maintain scalable ETL pipelines using PySpark and AWS Glue • Build and optimise data ingestion, transformation, and loading workflows • Orchestrate data workflows using AWS Step Functions • Develop serverless functions using AWS Lambda (Python) • Work with data lake architectures on AWS to support analytical use cases • Ensure pipeline reliability, monitoring, and performance optimisation

🎯 Requirements

• 4-8 years of experience in data engineering • Strong hands-on experience with PySpark • Proven track record in ETL pipeline development and optimisation • Experience orchestrating workflows with AWS Step Functions • Proficiency in serverless development using AWS Lambda (Python) • Good SQL skills and a solid understanding of data processing principles

🏖️ Benefits

• Competitive salary

Apply Now

Similar Jobs

🕒 October 28, 2025

EY

10,000+ employees

🏥 Healthcare

⚖️ Legal

📣 Marketing

Duck Creek Support with 6 to 8 years of experience handling support projects. Proficient in Duck Creek maintenance and supporting deployments in a global delivery network.

Java

Jenkins

SDLC

SOAP

Spring

Spring Boot

SpringBoot

Subversion

🕒 July 29, 2025

Codvo.ai

51 - 200

🤖 Artificial Intelligence

🔒 Cybersecurity

☁️ SaaS

Architect and implement cloud solutions to enhance enterprise client journeys at Codvo.

AWS

Azure

Cloud

Docker

Firewalls

Google Cloud Platform

Kubernetes

Terraform