Senior Data Engineer, Databricks Specialist

Yesterday

Apply Now

Receive Emails with Similar Jobs

Coderio

WebsiteLinkedInAll Job Openings

B2B • Enterprise • Artificial Intelligence

Coderio is a nearshore software development firm that provides on-demand engineering teams, IT staff augmentation, and fully managed software outsourcing to accelerate clients' digital transformation. They deliver front-end, back-end, mobile, cloud, data science, e-commerce, and QA solutions, and operate specialized studios for Data Governance, Machine Learning & AI, and Open Banking. Coderio emphasizes enterprise-level, timezone-aligned, fully-vetted, English-proficient engineering talent for B2B customers.

201 - 500 employees

Founded 2017

🤝 B2B

🏢 Enterprise

🤖 Artificial Intelligence

📋 Description

• Architect and implement scalable Lakehouse solutions using Delta Tables and Delta Live Tables to ensure performance, consistency, and reliability. • Design and orchestrate complex data workflows using Databricks Workflows and Jobs, leveraging Databricks Asset Bundles for deployment management. • Manage platform internals, including low-level Cluster Configuration, optimization through the Databricks CLI, and environment tuning. • Implement secure data governance and sharing using Unity Catalog and Delta Sharing. • Develop production-grade Python and PySpark code, including custom Python libraries to standardize logic across pipelines. • Collaborate with engineering and platform teams to drive improvements in scalability, maintainability, and operational efficiency. • Act as a technical leader who supports decision-making, provides clarity under ambiguity, and drives continuous improvement.

🎯 Requirements

• 3+ years of hands-on experience across the full Databricks ecosystem, including Notebooks, Workflows, Jobs, Asset Bundles, Cluster Configuration, CLI usage, Unity Catalog, Delta Sharing, and Delta Live Tables. • 4+ years of deep experience in Data Engineering fundamentals, including Data Modeling, Data Warehouse principles, ETL processes, and pipeline orchestration. • 4+ years of proficiency in Python, PySpark, and SQL building production-grade data solutions. • 3+ years working with Azure services such as Storage Accounts, Azure Active Directory, and Azure Data Factory. • 2+ years of experience using GitHub SaaS and GitHub Actions for version control and deployment. • Strong communication, collaboration, and problem-solving abilities, with a demonstrated capacity to operate effectively under ambiguity.

🏖️ Benefits

• 100% remote • Long-term commitment, with autonomy and impact • Strategic and high-visibility role in a modern engineering culture • Collaborative international team and strong technical leadership • Clear path to growth and leadership within Coderio