Data Engineer

March 19

Smart Pension

WebsiteLinkedInAll Job Openings

Our mission is to transform retirement, savings and financial wellbeing, across all generations, around the world.

Auto enrolment • Workplace pensions • Pensions administration platform • DC Pension Scheme • Technology

501 - 1000

💰 Private Equity Round on 2022-07

Description

• As part of the Backend Engineering function, the Data Engineer will be working on planning, engineering, and maintaining clients’ data warehouses, ETL processes, and other data pipelines. • The Smart Data Engineering team is responsible for maintaining the UK Smart Data Warehouse, data for BI reports and dashboards, data engineering support for migrating clients onto Smart’s Keystone platform, validating system functionality changes, maintaining client data extracts, and implementing new/improved data pipelines. • The Data Engineer will work with stakeholders to identify new data sources, implement new data pipelines, maintain existing data pipelines, monitor performance/security/scalability, evaluate data warehouse solutions, and impact assess change requests.

Requirements

• 4+ years’ work experience in Python Development - with a focus on data analysis/migration/engineering • 5+ years’ work data engineering, with proven experience in Data Modelling • Experience writing, troubleshooting, and debugging complex SQL queries • Experience writing, troubleshooting, and debugging Python Code (v 3.9+) • Ability to write automated Python tests (unit, functional, and integration) • Experience of extracting data from REST APIs and manipulating/loading it into a database • Working knowledge of Snowflake or Redshift data warehouses • Experience with ETL/ELT processes and tools (preferably with Matillion and/or Apache Airflow) • Hands-on experience with AWS (notably ECS and S3) • Financial services experience • Experience designing and implementing data warehouses • Experience developing and maintaining Apache Airflow DAGs to implement data pipelines • Hands on experience using DBT to manage and implement data transformations • A working understanding of Docker • Experience working with big data and/or MPP (massively parallel processing) databases • Experience supporting applications running on Amazon AWS • Experience in Continuous delivery and automation pipelines using Github Actions

Benefits

• 25 days’ holiday per year, increasing with length of service. • £500 annual training budget to spend on your professional development • Extensive private healthcare, including dental, eyecare and EAP • Enhanced sick leave (three months’ pay per year) • Enhanced maternity and paternity (maternity – 6 months fully paid/paternity – 3 weeks fully paid) • Death in service insurance cover • Fully-paid five-week sabbatical after five years of employment • In office wellbeing, such as manicures, massages and barbers. We also serve free lunch, breakfasts and social drinks weekly. • Smart employees also enjoy a 50% discount on orders from our sister company Arena Flowers