Senior Data Engineer – Azure Databricks

🕒 March 14

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Billigence

WebsiteLinkedInAll Job Openings

201 - 500 employees

🤝 B2B

🤖 Artificial Intelligence

☁️ SaaS

B2B • Artificial Intelligence • SaaS

Billigence is a data-focused company that specializes in advisory services, training, and solutions to empower businesses with data. They offer services in data governance, data visualization, data science, AI, and more, providing tools and insights to help businesses harness their data's full potential. With a strong focus on data strategy and governance, Billigence partners with leading technology platforms like Snowflake, Alteryx, and H2O. ai to deliver bespoke solutions tailored to customer needs across various industries. Their expertise extends across telecommunications, media, and financial services, ensuring clients can navigate complex data landscapes efficiently.

📋 Description

• Build and optimise data pipelines within Azure Databricks • Support migration of existing Azure Synapse notebook pipelines • Design scalable data models and storage patterns within Delta Lake • Integrate historical data from on-premise data warehouses • Build new ingestion pipelines from SQL Server stored procedures • Implement scalable ingestion frameworks and reusable pipeline patterns • Collaborate with global data engineering teams across the UK and India • Contribute to best practices and platform standards for future pipeline development

🎯 Requirements

• Strong experience working as a Data Engineer or Senior Data Engineer • Hands-on experience with Azure Databricks • Strong understanding of Delta Lake architecture • Experience with Azure Synapse, Spark, and modern cloud data platforms • Strong SQL and experience working with enterprise data systems • Experience building data pipelines and ETL/ELT frameworks • Ability to work effectively in distributed global teams • Experience within Financial Services or regulated industries is beneficial