Lead Data Engineer – Platform

🕒 May 11

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Valtech

WebsiteLinkedInAll Job Openings

5001 - 10000 employees

Founded 1997

🤝 B2B

☁️ SaaS

B2B • Marketing • SaaS

Valtech is a global digital agency focusing on experience innovation. They strive to transform businesses through a combination of technology, marketing, and data strategies. Valtech helps companies elevate their digital presence and drive commerce strategies, enhance enterprise digital transformations, and unlock marketing and performance potential. They also utilize data and AI to help organizations harness the power of information. With offices around the world, Valtech partners with businesses to shape their digital futures, offering a range of services and insights designed to enhance customer experiences.

📋 Description

• Design, build, and maintain scalable data engineering frameworks and platform utilities used across engineering teams • Develop reusable patterns, templates, and abstractions to standardise and accelerate delivery • Define and evolve platform architecture decisions, ensuring scalability, maintainability and consistency • Design and implement CI/CD pipelines and automation frameworks to improve engineering velocity • Define and enforce engineering standards for testing, code quality, deployment and documentation • Identify and eliminate manual or repetitive processes through automation and tooling improvements • Integrate AI-assisted development tools into engineering workflows to improve productivity • Develop and maintain AI engineering assets such as coding guidelines, prompt frameworks and reusable agent configurations • Lead the development and operational support of core data transformation frameworks (including dbt Core at enterprise scale) • Investigate and resolve framework-level issues, including deployment failures, dependency conflicts and production incidents • Support onboarding and enablement of engineering teams adopting platform tooling • Act as the main technical point of contact for platform and framework-related queries • Partner with engineering teams to identify pain points and translate them into platform improvements • Ensure platform tooling meets security, compliance and operational requirements • Conduct and support code and design reviews across platform components • Monitor platform health, performance and adoption, iterating based on feedback and metrics • Contribute to documentation, developer guides and enablement materials to improve usability and adoption

🎯 Requirements

• Strong proficiency in Python for building frameworks, automation tooling and reusable components • Hands-on experience with Databricks (including notebooks, workflows, jobs and Unity Catalog) • Strong SQL skills and experience with distributed processing frameworks such as Apache Spark • Deep experience with dbt Core, including project structure, models, tests, macros and deployment at scale • Proven experience designing and maintaining CI/CD pipelines (e.g. GitHub Actions, Azure DevOps or GitLab CI) • Experience with data engineering platform design, including scalable pipeline and workflow architectures • Strong understanding of software engineering principles (DRY, SOLID, modular design) • Experience with cloud platforms (preferably AWS) and infrastructure-as-code concepts (e.g. Terraform) • Experience implementing automated testing strategies (unit, integration, data quality) • Strong understanding of platform monitoring, logging and alerting practices • Experience writing technical documentation and developer-facing guidance • Experience working in complex engineering environments with multiple teams

🏖️ Benefits

• 24 working days of paid vacation • National holidays covered • Sick leave (up to 20/year) • Unpaid leave (up to 20/year) • Medical insurance • Multisport card OR Multikafeteria • Maternity & paternity leave support • Internal workshops & learning initiatives • Professional certifications reimbursement • Participation in professional local & global communities • Growth Framework to manage expectations and define the steps to move towards the selected career • Mentoring program with the ability to become a mentor or a mentee to grow to a higher position • Flexibility, with remote and hybrid work options (country-dependent) • Career advancement, with international mobility and professional development programs • Learning and development, with access to cutting-edge tools, training and industry experts