Senior Data Engineer

🕒 March 26

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Shuru

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2021

🤖 Artificial Intelligence

🤝 B2B

🏢 Enterprise

Artificial Intelligence • B2B • Enterprise

Shuru is a product, AI, and technology consulting firm that partners with businesses to deliver strategic consulting, full-cycle product and custom software development, and curated engineering team extension. Their AI-native engineering teams build scalable AI applications, data engineering and analytics, cloud/DevOps, and API integrations to modernize systems and accelerate product delivery. Shuru operates globally with a remote-first model and emphasizes high ownership, design thinking, and measurable outcomes for enterprise and startup clients.

📋 Description

• Work closely with source system teams and reporting teams to gather, analyze, and translate data requirements into scalable data pipelines. • Design, develop, and maintain robust ETL/ELT pipelines using PySpark, SQL, and Delta Lake on Azure Databricks. • Ingest and integrate data from multiple sources including MariaDB, Azure Event Hubs, APIs, and flat file systems. • Build and optimize data models across bronze, silver, and gold layers using Delta tables. • Ensure data reliability, accuracy, and freshness through monitoring, testing, and validation. • Apply and enforce data governance, security, and compliance policies throughout the pipeline lifecycle. • Collaborate with analysts, data scientists, and engineers to enable downstream data usage. • Promote engineering excellence through code reviews, documentation, CI/CD, and automation. • Mentor junior engineers and provide guidance on design and best practices. • Explore emerging technologies such as Structured Streaming, and support their adoption where beneficial.

🎯 Requirements

• 5+ years of experience in data engineering or similar roles. • At least 1 year in a senior or technical lead capacity. • Proven experience with Azure Databricks, Delta Lake, and Spark-based data pipelines. • Experience integrating data from multiple sources such as MariaDB, Event Hubs, APIs, or file systems. • Exposure to version control (e.g., Git), CI/CD pipelines, and Agile methodologies. • Familiarity with Structured Streaming and real-time data processing is a plus. • Experience in fintech, broking, or financial services domains is an advantage.

🏖️ Benefits

• Competitive salary and benefits package. • Opportunity to work with a team of experienced product and tech leaders. • A flexible work environment with remote working options. • Continuous learning and development opportunities. • Chance to make a significant impact on diverse and innovative projects.