Azure Databricks Infrastructure Engineer

Job not on LinkedIn

🔥 3 minutes ago

🇺🇸 United States – Remote

⏰ Full Time

🟠 Senior

🔴 Lead

👷 Infrastructure Engineer

👻 Ghost score 25%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

CloudScouts

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2019

💼 Consulting

📣 Marketing

💸 Finance

Consulting • Marketing • Finance

CloudScouts is a technology consulting firm specializing in enterprise performance management (EPM), financial planning, consolidation, and data & analytics solutions. They implement and support platforms such as SAP Analytics Cloud (Planning and BI), Kepion Enterprise Planning and Financial Consolidation, SAP S/4HANA Group Reporting, and Power BI to simplify budgeting, forecasting, group financial consolidation, and analytics for corporate clients. CloudScouts focuses on tailored implementations, integrations, and ongoing support to help organizations improve financial decision-making and reporting accuracy.

📋 Description

• Analyze tenant-specific dependencies, networking requirements, DNS, Private Endpoints, and identity integrations • Define migration waves and cutover strategies • Migrate Databricks workspaces between Azure tenants • Rebuild or migrate workspaces, compute policies, job schedules, repositories, workflows, secret scopes, and access controls • Migrate notebooks, libraries, packages, and configuration artifacts • Validate Unity Catalog and data governance configurations • Implement infrastructure-as-code and automation • Migrate and validate Microsoft Entra ID integrations, managed identities, service principals, RBAC assignments, Databricks groups, and permissions • Coordinate Key Vault migration and secret rotation activities • Ensure compliance with the Principle of Least Privilege • Support security reviews and governance approvals • Assess and migrate associated datasets and storage integrations • Validate Delta Lake tables, metadata, and schemas • Develop rollback and recovery procedures • Automate migration and validation activities • Produce migration strategy and wave plan, detailed migration runbooks, cutover and rollback plans, and operational handover documentation • Lead migration activities from assessment through production cutover with minimal supervision • Engage architects, platform teams, security organizations, business stakeholders, and executive stakeholders

🎯 Requirements

• 13+ years profiles only • 7+ years of Azure cloud experience • 5+ years of Azure Databricks administration and engineering experience • Demonstrated experience migrating Azure resources across tenants • Experience with large-scale data platform migrations • Experience designing secure cloud landing zones • Experience implementing Infrastructure as Code • Experience working in regulated enterprise environments • Deep expertise in Databricks, Azure cloud services, identity and access management, networking, data engineering, and platform modernization • Required technical knowledge of Azure Databricks, Microsoft Entra ID, Azure Virtual Networks, Private Endpoints, Azure Key Vault, Azure Storage Accounts, Azure Data Lake Storage Gen2, Azure Monitor, Log Analytics, Azure Policy, Azure RBAC, Unity Catalog, Delta Lake, Databricks Repos, MLflow, cluster management, cluster policies, secret scopes, Databricks REST APIs, Terraform, Azure DevOps, GitHub Actions, PowerShell, Azure CLI, and Databricks CLI • Preferred: Azure Solutions Architect Expert certification, Databricks Administrator Certification, Databricks Solution Architect Certification • No OPT and no fake visas • Availability for telephonic and face-to-face interviews

🏖️ Benefits

• Full-time employment • Long-term contract • Remote work • Equal opportunity employment