Data Engineering Lead

🕒 May 7

🏢🏡 London – Hybrid

⏰ Full Time

🟠 Senior

🚰 Data Engineer

🇬🇧 UK Skilled Worker Visa Sponsor

This company has sponsored UK Skilled Worker visas in the past.

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Rail Delivery Group

WebsiteLinkedInAll Job Openings

201 - 500 employees

The Rail Delivery Group (RDG) brings together passenger and freight operators, Network Rail and HS2 to build a better railway, connecting the country and delivering more reliable services for customers.Investing for the long-term, we are working together to make journeys better and local economies stronger, giving communities the right to new economic opportunities, now and for generations to come.Note: On 24 October 2016, the Association of Train Operating Companies (ATOC) and the Rail Delivery Group adopted the single name of Rail Delivery Group. Find out more at http://www.raildeliverygroup.com/media-centre/press-releases/2016/469771023-2016-10-21.html

📋 Description

• Provide authoritative technical guidance on data engineering design and tools across RDG. • Lead the development, operation and continuous improvement of RDG’s data platform. • Oversee the implementation of complex data pipelines, integrations and transformations across batch and streaming workloads. • Make key decisions on data models, storage approaches, tooling and engineering techniques. • Lead, mentor and develop a team of data engineers. • Support the establishment of consistent engineering practices. • Provide guidance to engineers across other teams. • Work with Architecture, Information Security, Quality Assurance and other technical teams. • Collaborate with internal and external partners to support complex integrations, data flows and platform interactions. • Engage with business stakeholders to understand technical requirements. • Manage and prioritise the engineering workload and delivery. • Support the Head of Data, Analysis and Insights with shaping the future role of data. • Ensure appropriate controls, monitoring and operational processes are in place. • Maintain and enhance engineering standards across data quality, testing, and documentation.

🎯 Requirements

• Proven experience working with extremely large datasets (including tables with over 85 billion records) • Writing efficient SQL • Building both batch and streaming pipelines in Python • Hands-on AWS expertise in a data context within the last three years • Strong grasp of modern data storage and processing options (data lakes, warehouses, relational and key-value stores, and distributed frameworks like Spark) • Experience with CI/CD and DataOps • Champion best-practice data warehouse and data lake design • Drive automation and high standards in code quality

🏖️ Benefits

• 75% off rail travel for personal and family use, plus international rail discounts. • 30 Days annual leave (plus buy/sell options and additional leave for key life events) • Season ticket loan for commuting costs. • Enhanced family leave – 30 weeks full pay for maternity, adoption, surrogacy, and shared parental leave. • Pension scheme – up to 11.58% employer contribution. • Private medical insurance (Vitality PPP) including mental health and specialist care. • Discounted gym membership and access to wellbeing programmes.