Middle Data Engineer, Azure Databricks

🕒 June 23

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Miratech

WebsiteLinkedInAll Job Openings

501 - 1000 employees

Founded 1989

💰 Private Equity Round on 2022-04

Miratech helps visionaries to change the world. We are a global IT services and consulting company that brings together global enterprise innovation and start-up innovation. Today we support digital transformation for the largest enterprises on the planet.

📋 Description

• Design, develop, and maintain data pipelines using Azure Databricks • Build and optimize data transformations using PySpark and SQL in Databricks • Implement and maintain Lakehouse architectures using Delta Lake • Develop ETL/ELT pipelines orchestrated through Azure Data Factory • Integrate data from multiple sources into the data platform and analytical layers • Design and maintain data models and data warehouse structures for analytics • Ensure data quality, scalability, and performance of large-scale data processing pipelines • Collaborate with BI teams to support Power BI and reporting platforms • Support and evolve existing SQL Server data platforms and ETL solutions (SSIS) when required • Contribute to the design of modern cloud-based data architectures

🎯 Requirements

• 3+ years of experience in Data Engineering or Data Warehouse development • Experience with Azure Databricks • Experience developing data pipelines using PySpark and Spark SQL • Solid understanding of distributed data processing and big data concepts • Experience working with Delta Lake and Lakehouse architectures • Strong SQL skills and experience with SQL Server relational databases • Experience building data pipelines using Azure Data Factory • Experience handling large datasets and performance optimization • Nice to have • Experience with Spark optimization techniques (partitioning, caching, cluster tuning) • Experience with structured streaming in Databricks • Knowledge of CI/CD pipelines for data platforms (Azure Devops) • Familiarity with Power BI • Experience in migrating from traditional ETL process to cloud architectures

🏖️ Benefits

• Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth. • Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program. • Work From Anywhere Culture: make the most of the flexibility that comes with remote work. • Growth Mindset : reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities. • Global Impact: collaborate on impactful projects for top global clients and shape the future of industries. • Welcoming Multicultural Environment: be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events. • Social Sustainability Values: join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality.