Senior Databricks Engineer

🔥 0 minutes ago

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Bounteous

WebsiteLinkedInAll Job Openings

501 - 1000 employees

Founded 2003

🏢 Enterprise

☁️ SaaS

🤖 Artificial Intelligence

💰 Private Equity Round on 2021-08

Enterprise • SaaS • Artificial Intelligence

Bounteous is a digital solutions firm known for its co-innovation model, which assists leading brands in navigating digital transformations and enhancing user experiences. The company partners with businesses from various sectors such as financial services, healthcare, telecommunications, retail, and convenience, to deliver data-driven solutions. Bounteous offers expertise in areas including artificial intelligence, data analytics, digital commerce, and cloud enablement, helping its clients harness technology for sustained growth and brand loyalty. With a global presence, Bounteous is dedicated to creating personalized and effective digital strategies that drive business success.

📋 Description

• Architect, build, and maintain scalable ETL/ELT pipelines on the Databricks Lakehouse Platform using PySpark, Spark SQL, and Delta Lake. • Design and implement medallion (bronze/silver/gold) data architectures and enforce data quality, governance, and lineage standards. • Optimize Spark jobs and cluster configurations for performance and cost, including partitioning, caching, and autoscaling strategies. • Implement and manage Unity Catalog for access control, data governance, and cross-workspace asset sharing. • Build and orchestrate workflows using Databricks Workflows, Delta Live Tables, and CI/CD pipelines. • Collaborate with data scientists, analysts, and business stakeholders to translate requirements into reliable data products. • Establish engineering best practices, conduct code reviews, and mentor junior data engineers. • Monitor production pipelines, troubleshoot failures, and drive root-cause analysis and continuous improvement.

🎯 Requirements

• 5+ years of data engineering experience, with 3+ years building production solutions on Databricks and Apache Spark. • Expert proficiency in Python (PySpark) and advanced SQL. • Deep hands-on experience with Delta Lake, Unity Catalog, and the medallion architecture pattern. • Strong experience with at least one major cloud platform (AWS, Azure, or GCP) and its core data services. • Proven track record optimizing Spark performance and managing cluster cost. • Experience with data modeling, warehousing concepts, and building dimensional/analytics-ready datasets. • Proficiency with Git-based version control, CI/CD, and infrastructure-as-code. • Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.

🏖️ Benefits

• Accommodation provided during hiring process • Willingness to sponsor employment visas