Databricks Architect

🔥 0 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Cuesta Partners

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2019

🏥 Healthcare

📦 Logistics

📣 Marketing

Healthcare • Logistics • Marketing

Cuesta Partners is a management and technology consulting firm that helps organizations translate strategy into measurable outcomes, specializing in AI, data, and technology-driven transformations. The firm provides services across mergers & acquisitions (technology diligence and integration), technology strategy, data strategy and execution, AI strategy and implementation, and delivery & transformation to accelerate time-to-value for enterprise clients. Cuesta works with private equity, healthcare, pharma, distributors, and other mid-market and enterprise companies to unlock value through AI-ready data platforms, analytics, and operational change.

📋 Description

• Design and architect scalable Databricks-based solutions for enterprise clients • Lead end-to-end cloud data platform implementations across AWS and/or Azure • Design and build production pipelines using Databricks Workflows and Spark Declarative Pipelines • Design scalable ETL/ELT pipelines using Spark, PySpark, and Databricks Workflows • Partner directly with client stakeholders, including C-level executives, to understand business needs and translate them into technical solutions • Provide technical leadership and guidance to data engineering teams • Implement CI/CD pipelines and infrastructure-as-code for Databricks resources • Drive collaborative development through Git workflows, pull requests, and code reviews • Collaborate with analytics, engineering, and business teams • Serve as the primary technical point of contact for clients

🎯 Requirements

• 6+ years of experience in Data Engineering, Cloud Architecture, or related roles • 3+ years of hands-on experience with Databricks • Strong proficiency in PySpark, Spark SQL, Python, and SQL • Deep experience with Delta Lake, Unity Catalog, Delta Live Tables, and Databricks Jobs • Proven experience delivering Databricks projects in a consulting or professional services environment • Strong understanding of data lake concepts and formats, including Delta, Iceberg, and Parquet • Experience designing and managing Unity Catalog for governance, access control, and lineage • Familiarity with medallion architecture patterns • Hands-on experience with Git version control, pull requests, code reviews, and collaborative development workflows • CI/CD and infrastructure-as-code experience for Databricks resources, including Terraform, Asset Bundles, and GitHub Actions • MLflow experience in experiment tracking, model registry, deployment, and observability • Cloud platform experience • Experience working in client-facing, consulting, or cross-functional environments • Experience leading technical projects or mentoring engineering teams • Databricks certifications are nice to have • Experience with agentic AI workflows, Agentbricks, LangChain, and Claude agentic workflows is nice to have

🏖️ Benefits

• Constant opportunities for exposure & learning • Flexible working location and enabling personal-life harmony with work • Agency and influence in the company’s total strategy and direction • Collaboration with a high-performing team • Competitive base salary • Target bonus of 20-25% • 401k • Healthcare benefits • Paid time-off