Databricks Developer, Unity Catalog Migration

Job not on LinkedIn

🔥 14 hours ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

DysrupIT

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2016

🏢 Enterprise

☁️ SaaS

🔒 Cybersecurity

Enterprise • SaaS • Cybersecurity

DysrupIT is a global cloud services and IT solutions firm that helps organizations adopt cloud technologies and transition to as-a-Service business models. The company provides enterprise cloud, managed services, application engineering, cybersecurity, and data analytics & information management, serving SMBs through multinational enterprises with Microsoft and other cloud platforms. DysrupIT also emphasizes community impact, talent development, and long-term partnerships to deliver secure, scalable, and business-aligned technology outcomes.

📋 Description

• Design, develop, and maintain scalable data pipelines on the Databricks Lakehouse Platform. • Implement and administer Unity Catalog for enterprise data governance, access control, lineage, and data sharing. • Support hydrocarbon reporting workflows, including ingestion, transformation, validation, and reconciliation of production and operational data. • Develop ETL/ELT pipelines using Spark, Delta Lake, and Delta Live Tables (Lakeflow experience is a plus). • Optimize Databricks workloads for performance, reliability, and cost efficiency. • Collaborate with business stakeholders to translate reporting requirements into scalable technical solutions. • Implement data quality checks, monitoring, and automated validation frameworks. • Work closely with solution architects and data engineers on platform enhancements and production support. • Document technical designs, governance standards, and operational procedures. • Participate in code reviews, CI/CD implementation, and DevOps best practices.

🎯 Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or a related discipline. • 5+ years of data engineering experience with 3+ years of hands-on Databricks experience. • Strong experience implementing and managing Unity Catalog in enterprise environments. • Experience supporting Oil & Gas, Energy, or Hydrocarbon Reporting projects. • Expertise with: Databricks Lakehouse, Apache Spark (PySpark), Delta Lake, SQL, Python • Experience building enterprise ETL/ELT pipelines. • Experience with Azure Databricks (AWS Databricks also considered). • Strong understanding of data governance, security, metadata management, and lineage.

🏖️ Benefits

• health insurance • retirement plans • paid time off • flexible work arrangements • professional development