Middle Data Engineer, Azure Databricks

🕒 June 23

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Miratech

WebsiteLinkedInAll Job Openings

501 - 1000 employees

Founded 1989

💰 Private Equity Round on 2022-04

Miratech helps visionaries to change the world. We are a global IT services and consulting company that brings together global enterprise innovation and start-up innovation. Today we support digital transformation for the largest enterprises on the planet.

📋 Description

• Design, develop, and maintain data pipelines using Azure Databricks. • Build and optimize data transformations using PySpark and SQL in Databricks. • Implement and maintain Lakehouse architectures using Delta Lake. • Develop ETL/ELT pipelines orchestrated through Azure Data Factory. • Integrate data from multiple sources into the data platform and analytical layers. • Design and maintain data models and data warehouse structures for analytics. • Ensure data quality, scalability, and performance of large-scale data processing pipelines. • Collaborate with BI teams to support Power BI and reporting platforms. • Support and evolve existing SQL Server data platforms and ETL solutions (SSIS) when required. • Contribute to the design of modern cloud-based data architectures.

🎯 Requirements

• 3+ years of experience in Data Engineering or Data Warehouse development. • Experience with Azure Databricks. • Experience developing data pipelines using PySpark and Spark SQL. • Solid understanding of distributed data processing and big data concepts. • Experience working with Delta Lake and Lakehouse architectures. • Strong SQL skills and experience with SQL Server relational databases. • Experience building data pipelines using Azure Data Factory. • Experience handling large datasets and performance optimization. • Nice to have: Experience with Spark optimization techniques (partitioning, caching, cluster tuning). • Nice to have: Experience with structured streaming in Databricks. • Nice to have: Knowledge of CI/CD pipelines for data platforms (Azure Devops). • Nice to have: Familiarity with Power BI. • Nice to have: Experience in migrating from traditional ETL process to cloud architectures.

🏖️ Benefits

• Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program. • Work From Anywhere Culture: make the most of the flexibility that comes with remote work. • Growth Mindset: reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities. • Global Impact: collaborate on impactful projects for top global clients and shape the future of industries. • Welcoming Multicultural Environment: be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events. • Social Sustainability Values: join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality.