Lead Data Engineer, Databricks

πŸ•’ 5 days ago

Where this job comes from

Posted on v4c.ai's careers page β†—v4c.ai's careers page, not through a job board

First seen by Remote Rocketship 5 days ago

Still open on v4c.ai's site. Checked 19 hours ago.

Apply Now
Logo of v4c.ai

v4c.ai

51 - 200 employees

πŸ’Ό Consulting

πŸ₯ Healthcare

🏭 Manufacturing

Consulting β€’ Healthcare β€’ Manufacturing

v4c. ai is a Databricks-focused data and AI services firm that helps enterprises modernize data platforms and accelerate AI initiatives. They provide advisory, migration, MLOps, generative AI, and data governance services, plus prebuilt migration accelerators and production-ready ML pipelines to reduce time-to-value. v4c. ai serves regulated and data-intensive industries (financial services, retail, manufacturing, healthcare) and emphasizes Databricks implementation, scalable model deployment, and long-term operational support.

πŸ“‹ Description

β€’ Lead engineering on customer engagements, from design through production handover β€’ Build and optimize batch and streaming pipelines using PySpark, SQL, and Delta Lake on Databricks β€’ Implement Medallion architecture across cloud ecosystems and set the layer conventions the team follows β€’ Own performance and cost: benchmark Spark jobs, tune SQL, right-size compute, and explain the trade-offs to the customer β€’ Implement data quality and validation as code, including Lakeflow expectations and automated testing in CI β€’ Mentor mid-level and junior engineers through code review, pairing, and design feedback β€’ Partner with the Data Architect on design decisions, and escalate when implementation reveals the design will not hold

🎯 Requirements

β€’ 7+ years of data engineering plus experience leading projects or teams β€’ Strong proficiency in Python, SQL, Apache Spark, and Delta Lake β€’ Production experience building both batch and streaming pipelines at enterprise scale β€’ Hands-on experience with AWS, Azure, or GCP and its data services β€’ Experience with data modeling, Git, and CI/CD for data workloads β€’ Demonstrated experience optimizing Spark performance and managing platform cost β€’ Strong client communication skills, including the ability to explain technical trade-offs to a non-technical stakeholder β€’ Healthcare or life sciences experience preferred but not required β€’ Existing Databricks Certified Data Engineer Associate or Professional certification β€’ Hands-on experience with Unity Catalog, Lakeflow, or Databricks Asset Bundles β€’ Experience with dbt, Airflow, or equivalent orchestration and transformation tooling β€’ Experience migrating a legacy ETL estate to a modern cloud platform β€’ Consulting or client-facing engineering background

πŸ–οΈ Benefits

β€’ Unlimited PTO β€’ Health Care Plan (Medical, Dental & Vision) β€’ Retirement Plan (401k, IRA) β€’ Life Insurance (Basic, Voluntary & AD&D) β€’ Family Leave (Maternity, Paternity) β€’ Short Term & Long Term Disability β€’ Training & Development

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ 5 days ago

Zifo

1001 - 5000

πŸ’Ό Consulting

πŸ₯ Healthcare

πŸ“¦ Logistics

Data Engineer building clinical data pipelines, models, APIs, and AI-ready datasets. Supporting Zifo’s biopharma and healthcare clients with scientific R&D transformation.

πŸ•’ 6 days ago

Alignment Health

501 - 1000

βš•οΈ Healthcare Insurance

πŸ›‘οΈ Insurance

πŸ₯ Healthcare

Director leading Alignment Health’s enterprise healthcare data platform for Medicare Advantage operations. Driving compliant data products, governance, roadmap delivery, and AI/ML enablement.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $172.4k - $258.5k / year

πŸ’° $135M Series C on 2020-03

⏰ Full Time

🟠 Senior

πŸ”΄ Lead

🚰 Data Engineer

πŸ•’ 6 days ago

Chainstack πŸ› οΈπŸ’™

51 - 200

🌐 Web 3

β‚Ώ Crypto

Product Engineer building high-scale blockchain data access and indexing systems at Chainstack. Owning backend infrastructure, performance, observability, and production delivery end to end.

πŸ•’ 6 days ago

Agiloft

201 - 500

βš–οΈ Legal

πŸ’Ό Consulting

πŸ₯ Healthcare

Staff Data Engineer leading contract data models, pipelines, and analytics infrastructure. Building data foundations for Agiloft’s AI-powered contract lifecycle management platform.

πŸ•’ 6 days ago

Sierra Nevada Corporation

1001 - 5000

πŸš€ Aerospace

πŸŽ–οΈ Defense

🏭 Manufacturing

Senior Data Product Architect shaping enterprise data architecture, governance, and integration for SNC, a leading aerospace and national security company. Developing data blueprints, models, and roadmaps.

Developed byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok