Azure Databricks Architect

Stelle nicht auf LinkedIn

🕒 vor 12 Tagen

Jetzt Bewerben

Ähnliche Remote-Jobs finden

E-Mails für Remote-Jobs erhalten

📊 Überprüfen Sie Ihre Lebenslauf-Bewertung für diese Stelle

Verbessern Sie Ihre Chancen auf ein Vorstellungsgespräch, indem Sie Ihre Lebenslauf-Bewertung vor der Bewerbung überprüfen.

Lebenslauf hochladen

opinov8

WebsiteLinkedInAlle Stellen

201 - 500 Mitarbeiter

Gegründet 2017

🤝 B2B

🏢 Unternehmen

B2B • Enterprise

opinov8 ist ein globales Unternehmen für digitale und technische Lösungen, das sich auf maßgeschneiderte Software, Cloud- und Datenservices spezialisiert hat. Mit Hauptsitz in London und Entwicklungszentren sowie Remote-Teams in der Ukraine, Ägypten, Kolumbien, Portugal und der EU, arbeitet opinov8 mit Unternehmen weltweit zusammen, um die digitale Transformation durch maßgeschneiderte Ingenieurskunst, Cloud-Migrationen und datengestützte Lösungen zu beschleunigen. Das Unternehmen agiert als Remote-First-Dienstleister im B2B-Segment und bedient Kunden aus Branchen wie Finanzen, Gesundheitswesen, Logistik und Medien.

Beschreibung

• Architect and design enterprise-scale data platforms leveraging Azure Databricks and Azure cloud services; • Define and implement Lakehouse architecture patterns using Delta Lake and Databricks best practices; • Design scalable data ingestion, transformation, and serving frameworks supporting both batch and streaming workloads; • Design and implement real-time and near real-time data processing solutions using Structured Streaming, CDC, Change Data Feed (CDF), and event-driven architectures; • Design and manage multi-workspace Databricks environments and shared Metastore architectures. • Establish platform governance, security controls, cluster policies, RBAC models, and access management frameworks; • Design and implement CI/CD pipelines for Databricks assets, infrastructure, and data workloads. • Automate infrastructure provisioning using Infrastructure as Code (Terraform, ARM, or Bicep); • Develop deployment strategies and release management processes across development, staging, and production environments; • Optimize Databricks workspaces, clusters, jobs, and storage configurations for performance and cost efficiency; • Implement monitoring, alerting, logging, and observability solutions for platform operations; • Define and enforce data architecture standards, data quality frameworks, and governance policies; • Integrate Azure Databricks with Azure Data Factory, Azure Synapse, Azure Storage, Azure Key Vault, Azure Entra ID, and other Azure services; • Support Lakeflow Connect, managed connectors, CDC implementations, and enterprise data ecosystem interoperability; • Collaborate with engineering and business teams to translate requirements into scalable technical solutions; • Provide architectural guidance, technical leadership, and mentorship to engineering teams.

🎯 Anforderungen

• 7+ years of experience in Data Engineering, Data Platform Engineering, Cloud Data Architecture, or Data Platform Consulting. • 3+ years of hands-on experience architecting solutions with Azure Databricks. • Strong expertise in Apache Spark, PySpark, Delta Lake, and Databricks Lakehouse architecture. • Hands-on experience with Unity Catalog, data governance, lineage, permissions models, and catalog isolation strategies. • Experience designing and managing Databricks Metastore and multi-workspace architectures. • Strong knowledge of Databricks administration, user provisioning, RBAC, workspace management, and security controls. • Extensive experience designing cloud-native solutions on Microsoft Azure. • Strong knowledge of Azure Data Factory, Azure Storage, Azure Key Vault, Azure Monitor, Azure Entra ID, and Azure networking concepts. • Experience designing streaming and low-latency data pipelines using Databricks Structured Streaming. • Hands-on experience with CDC, Change Data Feed (CDF), and modern data ingestion patterns. • Hands-on experience building and maintaining CI/CD pipelines using Azure DevOps and/or GitHub Actions. • Experience implementing Infrastructure as Code using Terraform, ARM Templates, or Bicep. • Strong understanding of DevOps principles, deployment automation, and environment management. • Strong SQL and Python programming skills. • Excellent communication, stakeholder management, and consulting skills.

🏖️ Vorteile

• Digital-First Approach: Great talent knows no borders! You can work from wherever you are — we hire and collaborate with professionals worldwide. • Remote Work Model: Balance your professional and personal life with our flexible working conditions, empowering you to deliver your best from anywhere. • Exciting Projects: Dive into impactful projects across industries that challenge and spark creativity. • Boost Your Expertise: Grow your career with continuous learning, development opportunities, and hands-on experience. • Join the Best Team Ever: Collaborate with our diverse and cross-cultural team of passionate technologists and creative thinkers.