Databricks Architect

🕒 May 15

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Cuesta Partners

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2019

🤖 Artificial Intelligence

🏢 Enterprise

🤝 B2B

Artificial Intelligence • Enterprise • B2B

Cuesta Partners is a management and technology consulting firm that helps organizations translate strategy into measurable outcomes, specializing in AI, data, and technology-driven transformations. The firm provides services across mergers & acquisitions (technology diligence and integration), technology strategy, data strategy and execution, AI strategy and implementation, and delivery & transformation to accelerate time-to-value for enterprise clients. Cuesta works with private equity, healthcare, pharma, distributors, and other mid-market and enterprise companies to unlock value through AI-ready data platforms, analytics, and operational change.

📋 Description

• Design and architect scalable Databricks-based solutions for enterprise clients. • Lead end-to-end cloud data platform implementations across AWS and/or Azure. • Design and build production pipelines using Databricks Workflows and Spark Declarative Pipelines. • Design scalable ETL/ELT pipelines using Spark, PySpark, and Databricks Workflows. • Partner directly with client stakeholders to understand business needs and translate them into technical solutions. • Provide technical leadership and guidance to data engineering teams. • Implement CI/CD pipelines and infrastructure-as-code for Databricks resources. • Drive collaborative development through Git workflows, pull requests, and code reviews. • Collaborate cross-functionally with analytics, engineering, and business teams. • Serve as the primary technical point of contact for clients, including C-level executives.

🎯 Requirements

• 6+ years of experience in Data Engineering, Cloud Architecture, or related roles. • 3+ years of hands-on experience with Databricks. • Strong proficiency in PySpark, Spark SQL, Python, and SQL. • Deep experience with Delta Lake, Unity Catalog, Delta Live Tables, and Databricks Jobs. • Proven experience delivering Databricks projects in a consulting or professional services environment. • Strong understanding of data lake concepts and formats (Delta, Iceberg, Parquet, etc.). • Experience designing and managing Unity Catalog for governance, access control, and lineage. • Familiarity with medallion architecture (bronze/silver/gold) patterns. • Hands-on experience with Git version control, pull requests, code reviews, and collaborative development workflows. • CI/CD and infrastructure-as-code for Databricks resources (Terraform, Asset Bundles, GitHub Actions). • MLflow experience: experiment tracking, model registry, deployment, and observability. • Cloud platform experience. • Experience working in client-facing, consulting, or cross-functional environments. • Experience leading technical projects or mentoring engineering teams.

🏖️ Benefits

• Constant opportunities for exposure & learning • Flexible working location and enabling personal-life harmony with work • Agency and influence in the company’s total strategy and direction • Collaboration with a high-performing team • Competitive base salary (outlined in this listing) and target bonus of 20-25% • 401k, healthcare benefits, paid time-off, and more!