Middle Data Engineer, Azure Databricks

🔥 0 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Miratech

WebsiteLinkedInAll Job Openings

501 - 1000 employees

Founded 1989

🤝 B2B

💼 Consulting

☁️ SaaS

💰 Private Equity Round on 2022-04

B2B • Consulting • SaaS

Miratech is a global IT services and consulting company dedicated to helping visionaries change the world. Specializing in outsourcing, software development, and professional services, Miratech supports digital transformation for some of the largest enterprises worldwide. By combining enterprise and start-up innovation, Miratech remains at the forefront of technology while maintaining agility and a culture of relentless performance that has led to high engagement success since its founding in 1989.

📋 Description

• Design, develop, and maintain data pipelines using Azure Databricks • Build and optimize data transformations using PySpark and SQL in Databricks • Implement and maintain Lakehouse architectures using Delta Lake • Develop and maintain ETL/ELT pipelines orchestrated through Azure Data Factory • Integrate data from multiple sources into data platform and analytical layers • Design and maintain data models and data warehouse structures for analytics • Ensure data quality, scalability, and performance of large-scale data processing pipelines • Collaborate with BI teams to support Power BI and reporting platforms • Support and evolve existing SQL Server data platforms and SSIS ETL solutions when required • Contribute to the design of modern cloud-based data architectures

🎯 Requirements

• 3+ years of experience in Data Engineering or Data Warehouse development • Experience with Azure Databricks • Experience developing data pipelines using PySpark and Spark SQL • Solid understanding of distributed data processing and big data concepts • Experience with Delta Lake and Lakehouse architectures • Strong SQL skills and experience with SQL Server relational databases • Experience building data pipelines using Azure Data Factory • Experience handling large datasets and performance optimization • Nice to have: Spark optimization techniques including partitioning, caching, and cluster tuning • Nice to have: Structured streaming in Databricks • Nice to have: CI/CD pipelines for data platforms using Azure DevOps • Nice to have: Power BI • Nice to have: Migrating traditional ETL processes to cloud architectures • Strong analytical and problem-solving skills • Ability to work in collaborative environments and adapt • Commitment to continuous learning and professional development with focus on cloud computing • Good communication skills with technical and non-technical roles • Proactive approach to identifying improvements and proposing solutions • Comfort working in dynamic environments where priorities and technologies evolve

🏖️ Benefits

• Health insurance • Relocation program • Remote work flexibility / Work From Anywhere Culture • Professional development opportunities • Certification programs • Mentorship and talent investment programs • Internal mobility opportunities • Internship opportunities • Inclusive and supportive work environment • Open communication • Regular team-building company social events • Sustainable business practices focused on IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality