Senior Azure Databricks Architect

🔥 0 minutes ago

🇨🇦 Canada – Remote

⏳ Contract/Temporary

🟠 Senior

🏛️ Architect

👻 Ghost score 11%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Data Elephant

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2022

💼 Consulting

📣 Marketing

📦 Logistics

Consulting • Marketing • Logistics

Data Elephant is a Vancouver-based data and analytics consultancy founded in 2022 that helps organizations modernize data infrastructure and platforms to enable self-service reporting, advanced analytics, AI, and machine learning. They offer end-to-end services including data strategy, cloud migration, data engineering (warehouses, lakes, lakehouses), governance, BI, MLOps, and GenAI proof-of-concept and training, partnering with cloud and analytics providers like AWS, Databricks, and Microsoft. Data Elephant serves enterprise clients across industries (energy, mining, finance, transportation, retail, sports, public sector) and positions itself as a trusted advisor delivering measurable business outcomes through collaboration and long-term partnerships.

📋 Description

• Lead the architecture and deployment of secure Azure Databricks environments for enterprise clients • Design secure, scalable Azure Databricks platform architectures • Deploy and configure Azure Databricks workspaces using Terraform and infrastructure-as-code practices • Design and implement Azure Private Link and private endpoint connectivity for Databricks • Configure front-end, back-end, and browser-authentication private connectivity • Design customer-managed VNet and VNet-injected Databricks deployments • Implement Secure Cluster Connectivity and no-public-IP configurations • Design private DNS zones, DNS resolution, routing, NSGs, user-defined routes, and firewall rules • Integrate Databricks into hub-and-spoke and other enterprise Azure network architectures • Troubleshoot DNS, routing, authentication, and connectivity issues with security and networking teams • Design identity and access controls using Microsoft Entra ID and Databricks Unity Catalog • Establish architecture standards and deployment patterns across development, test, and production environments • Implement CI/CD processes for Databricks infrastructure and platform configuration • Produce architecture diagrams, design decisions, deployment documentation, and operational runbooks • Provide technical leadership and guidance to data engineers, cloud engineers, and client stakeholders • Support implementation through production deployment

🎯 Requirements

• Significant experience architecting and implementing Azure Databricks environments • Hands-on experience deploying Azure Databricks using Terraform • Demonstrated experience implementing Azure Private Link and private endpoints for Databricks • Experience with VNet injection, customer-managed VNets, Secure Cluster Connectivity, and no-public-IP deployments • Strong understanding of Azure networking, including private DNS zones, DNS resolution, hub-and-spoke architectures, Azure firewalls, network security groups, user-defined routes, and ExpressRoute or VPN connectivity • Experience with Terraform resources • Experience designing secure connectivity between Databricks and Azure services such as ADLS Gen2, Key Vault, Azure SQL, and Event Hubs • Strong knowledge of Databricks security, identity, access management, Unity Catalog, and service principals • Experience establishing CI/CD and infrastructure-as-code practices for enterprise data platforms • Ability to translate security and business requirements into practical architecture decisions • Strong written and verbal communication skills, including experience working directly with clients and technical stakeholders • Databricks architecture or engineering certification is preferred • Relevant Microsoft Azure certification is preferred • Experience with Databricks Asset Bundles is preferred • Experience with Azure DevOps or GitHub Actions is preferred • Knowledge of data governance, medallion architecture, observability, and cloud cost management is preferred • Consulting or professional services experience is preferred

🏖️ Benefits

• Remote work within Canada • Contractor engagement