AIM Qualifications and Assessment Group
Education • Non-profit • Human Resources
AIM Qualifications and Assessment Group is a not-for-profit awarding organisation and Access Validating Agency with over 40 years of experience in creating and awarding qualifications, including Access to HE Diplomas. The organisation is dedicated to promoting inclusion, integrity, respect, and empowerment through flexible, professional, and technical qualifications ranging from Entry Level to Level 6. AIM also specializes in end-point assessments for apprenticeships in the creative, cultural, digital technologies, and professional services sectors, supporting various organisations in delivering quality training and assessments.
51 - 200 employees
Founded 2011
📚 Education
🤝 Non-profit
Senior Data Engineer
Job not on LinkedIn
November 23
AIM Qualifications and Assessment Group
Education • Non-profit • Human Resources
AIM Qualifications and Assessment Group is a not-for-profit awarding organisation and Access Validating Agency with over 40 years of experience in creating and awarding qualifications, including Access to HE Diplomas. The organisation is dedicated to promoting inclusion, integrity, respect, and empowerment through flexible, professional, and technical qualifications ranging from Entry Level to Level 6. AIM also specializes in end-point assessments for apprenticeships in the creative, cultural, digital technologies, and professional services sectors, supporting various organisations in delivering quality training and assessments.
51 - 200 employees
Founded 2011
📚 Education
🤝 Non-profit
📋 Description
• Design, implement, and maintain data platforms and pipelines leveraging Microsoft Fabric, Azure Data Factory (ADF), SQL Server, and SSIS. • Develop and optimize ETL/ELT workflows for structured and unstructured data using ADF, Fabric Dataflows, and PySpark. • Integrate data from multiple sources (APIs, relational, and non-relational databases) into Lakehouse and SQL Server • Implement data transformation and cleansing logic using Python, PySpark, and Fabric notebooks. • Collaborate with Data Science and BI teams to prepare datasets for analytics, dashboards, and machine learning models. • Design and enforce data modeling best practices, including dimensional modeling for data warehouses. • Automate workflows using Power Automate for notifications, approvals, and orchestration of data refresh processes. • Monitor and improve data pipeline performance, ensuring scalability and reliability. • Manage metadata and data cataloging within Microsoft Fabric for discoverability and governance. • Develop incremental and real-time data ingestion strategies for large datasets. • Ensure compliance with data security and governance policies across all environments. • Provide technical guidance and mentorship to junior data engineers.
🎯 Requirements
• Bachelor’s degree in Computer Science, Data Engineering, or related field. • 5+ years of experience in data engineering with strong expertise in: Microsoft Fabric (Lakehouse, Dataflows, Pipelines) • Azure Data Factory (ADF) and SSIS • SQL Server (T-SQL, stored procedures, performance tuning) • Python and PySpark for data processing • Hands-on experience with ETL/ELT design, data warehousing, and dimensional modeling. • Familiarity with Power Automate for workflow automation. • Strong understanding of data governance, metadata management, and security best practices. • Experience with incremental loads, CDC (Change Data Capture), and real-time streaming. • Ability to troubleshoot and optimize data pipelines for performance and cost efficiency. • Excellent communication skills for cross-functional collaboration. • Knowledge of Azure services (Key Vault, Storage, Synapse) and Fabric integration. • Self-starter with a proactive approach to problem-solving and continuous improvement.
🏖️ Benefits
• Flexible work arrangements • Professional development
Apply NowSimilar Jobs
November 23
Abyss Solutions Ltd
51 - 200
Data Engineer optimizing operational workflows across projects for Abyss Solutions in the software operations industry. Utilizing Python and Bash scripting along with GCP/AWS services for deployment and automation.
November 20
Data Engineer (Adobe AEP) building and maintaining ingestion pipelines for diverse data sources in a remote setting. Seeking innovative individuals to join a forward-thinking team at TechBiz Global.
November 20
Data Architect (Adobe AEP) providing data architecture expertise for top clients. Designing ingestion pipelines and ensuring data governance in an innovative environment.
November 18
Data Architect designing and governing the data ecosystem for a ValueX platform at TechBiz Global. Ensuring scalability and collaboration with various teams for data architecture alignment.
October 14
Data Engineer responsible for designing, building, and maintaining reliable data pipelines and infrastructure. Collaborating with cross-functional teams to ensure data quality and accessibility for analytics.