Lead Data Engineer, Databricks

🔥 13 minutes ago

🇺🇸 United States – Remote

💵 $120k - $140k / year

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 1%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.Why this score:

• Just posted.
• Jobs at this company usually fill in 21 days.

Apply Now

Check your resume score

Customize resume + cover letter

Find Similar Remote Jobs

☆ Save☑️ Mark as applied❌ Hide

Report problem

v4c.ai

WebsiteLinkedInAll Job Openings

51 - 200 employees

💼 Consulting

🏥 Healthcare

🏭 Manufacturing

Consulting • Healthcare • Manufacturing

v4c. ai is a Databricks-focused data and AI services firm that helps enterprises modernize data platforms and accelerate AI initiatives. They provide advisory, migration, MLOps, generative AI, and data governance services, plus prebuilt migration accelerators and production-ready ML pipelines to reduce time-to-value. v4c. ai serves regulated and data-intensive industries (financial services, retail, manufacturing, healthcare) and emphasizes Databricks implementation, scalable model deployment, and long-term operational support.

📋 Description

• Lead engineering on customer engagements, from design through production handover • Build and optimize batch and streaming pipelines using PySpark, SQL, and Delta Lake on Databricks • Implement Medallion architecture across cloud ecosystems and set the layer conventions the team follows • Own performance and cost: benchmark Spark jobs, tune SQL, right-size compute, and explain the trade-offs to the customer • Implement data quality and validation as code, including Lakeflow expectations and automated testing in CI • Mentor mid-level and junior engineers through code review, pairing, and design feedback • Partner with the Data Architect on design decisions, and escalate when implementation reveals the design will not hold

🎯 Requirements

• 7+ years of data engineering plus experience leading projects or teams • Strong proficiency in Python, SQL, Apache Spark, and Delta Lake • Production experience building both batch and streaming pipelines at enterprise scale • Hands-on experience with AWS, Azure, or GCP and its data services • Experience with data modeling, Git, and CI/CD for data workloads • Demonstrated experience optimizing Spark performance and managing platform cost • Strong client communication skills, including the ability to explain technical trade-offs to a non-technical stakeholder • Healthcare or life sciences experience preferred but not required • Existing Databricks Certified Data Engineer Associate or Professional certification • Hands-on experience with Unity Catalog, Lakeflow, or Databricks Asset Bundles • Experience with dbt, Airflow, or equivalent orchestration and transformation tooling • Experience migrating a legacy ETL estate to a modern cloud platform • Consulting or client-facing engineering background

🏖️ Benefits

• Unlimited PTO • Health Care Plan (Medical, Dental & Vision) • Retirement Plan (401k, IRA) • Life Insurance (Basic, Voluntary & AD&D) • Family Leave (Maternity, Paternity) • Short Term & Long Term Disability • Training & Development

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume