Azure Data Engineer

3 days ago

Apply Now

Receive Emails with Similar Jobs

ProArch

WebsiteLinkedInAll Job Openings

Artificial Intelligence • Cybersecurity • Cloud

ProArch is a technology company that specializes in providing digital engineering, cloud services, data and AI solutions, and cybersecurity measures. They help businesses unleash their full potential by modernizing operations, protecting assets, and delivering data-driven insights. ProArch works closely with clients to eliminate roadblocks to growth and aligns advanced technology solutions with business goals to empower organizational success. As an award-winning Microsoft Gold Partner, they offer a wide range of services including AI consulting, software development, quality assurance, infrastructure management, governance, risk, and compliance solutions, and operational technology services. Their expertise extends to industries such as credit unions, power generation, and manufacturing, providing tailored solutions to meet each sector's unique challenges.

201 - 500 employees

🤖 Artificial Intelligence

🔒 Cybersecurity

📋 Description

• Design, develop, and optimize data pipelines using Azure Synapse Analytics, Spark Pools, and Azure Data Factory. • Write efficient Python and SQL code with a focus on scalability, performance, and optimization. • Manage Azure Data Lake for structured and unstructured data ingestion at scale (volume, variety, velocity). • Implement CI/CD pipelines and follow DataOps practices for automation and reliability. • Optimize data partitioning, versioning, and storage/compute costs for large-scale workloads. • Ensure high-quality solutions through unit testing frameworks and automated validation. • Collaborate with business teams to support analytics, reporting, and data science initiatives. • Mentor junior engineers, sharing knowledge and promoting engineering excellence.

🎯 Requirements

• Bachelor’s degree in computer science, IT, Data Engineering, or a related field. • 5+ years of experience in data engineering roles with proven expertise in cloud data platforms. • Expert in Python and SQL, with strong performance optimization skills. • Proficiency in Azure Synapse Analytics, Spark Pools, and Azure Data Factory (ADF). • Hands-on experience with Azure Data Lake and structured ingestion at scale. • Experience in CI/CD pipelines and applying DataOps principles. • Ability to manage large datasets with diverse structures, velocity, and volume. • **Good to Have Skills** • Experience with Delta Lake, versioned data, and advanced partitioning strategies. • Knowledge of data governance and security implementations across platforms. • Strong understanding of advanced data modelling (e.g., slowly changing dimensions). • Exposure to cost optimization strategies for cloud storage and compute. • Experience mentoring or providing technical leadership to junior engineers.