Data Engineer – Fixed Term Contract

Job not on LinkedIn

🔥 0 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Livestock Information Ltd

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2019

🌾 Agriculture

🔬 Science

Agriculture • Science • Technology

Livestock Information Ltd. is a service provider dedicated to enhancing livestock traceability and management in agriculture. Collaborating with government and industry stakeholders, the company utilizes data analytics and technology to improve disease control, productivity, and innovation across multiple livestock species in England. Their mission is to establish world-leading standards in livestock data management, benefiting farmers and the economy.

📋 Description

• Design and build new data services • Lead migrations of existing solutions • Ensure ongoing performance and enhancement of live data platforms • Design and implement Azure data storage solutions and schemas • Build and maintain scalable data pipelines for data movement, integration, and processing • Collect, transform, and load data using Azure Data Factory and Azure Databricks • Test and validate data quality and accuracy throughout pipelines • Tune and monitor pipeline performance, resolve bottlenecks, and optimise processing algorithms • Develop and maintain data models and schemas • Collaborate with cross-functional teams to provide data for analytics and reporting • Ensure Azure data processing complies with security and privacy requirements including GDPR • Work with datasets of hundreds of millions and billions of rows and perform data analysis • Stay updated on Azure features, updates, and best practices • Undertake other duties assigned by the line manager as appropriate

🎯 Requirements

• Proven experience in Python programming for data engineering and analytics • Strong proficiency in SQL, including the Microsoft T-SQL dialect • Hands-on experience with Azure data storage solutions • Practical knowledge of data integration and processing frameworks such as Azure Databricks and Azure Data Factory • Solid understanding of data modelling concepts and schema design best practices • Strong analytical and problem-solving skills, with excellent attention to detail • Effective communication skills and ability to work collaboratively within cross-functional teams • Must be able to work without employer-sponsored work visa, as Livestock Information Ltd. cannot sponsor work visas at this time

🏖️ Benefits

• A fully remote and flexible working set up • 25 days annual leave, increasing by 1 day each year of service up to maximum of 30 days (plus Bank Holidays) • 1 Privilege Day • 4 x annual salary Life Assurance • Market leading pension scheme through Legal & General • Enhanced Family Friendly Policies • Excellent learning, training, and career development opportunities • 24/7 access to our Employee Assistance Programme • A diverse and inclusive culture where everyone is respected and valued