Senior Data Engineer, Databricks

Job not on LinkedIn

🕒 September 4

🇺🇸 United States – Remote

💵 $150k - $180k / year

⏰ Full Time

🟠 Senior

🚰 Data Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 5%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Livefront

WebsiteLinkedInAll Job Openings

11 - 50 employees

💼 Consulting

📣 Marketing

☁️ SaaS

Consulting • Marketing • SaaS

Livefront is a company that helps other companies grow by creating digital products that people love. Since 2001, they have shaped the way companies win in the digital space by designing, building, and scaling core digital products and experiences. Their services include strategy consulting, design, product development, and integration of data and AI to create personalized experiences. Livefront is a trusted partner of large brands, helping them strategically implement AI to enhance the development and performance of digital products. They have worked on projects transforming educational support, smart home automation, and digital engagement for consumer brands.

📋 Description

• Design and build production data pipelines using Lakeflow Declarative Pipelines, Autoloader, and Structured Streaming • Own ingestion, transformation, data quality expectations, and CI/CD deployment via Declarative Automation Bundles • Architect and implement Databricks Lakehouse solutions using medallion architecture, Delta Lake, and Unity Catalog • Build and maintain DLT pipelines, PySpark notebooks, and dbt transformation layers with data quality constraints and SLAs • Design and maintain data and AI foundations using Unity Catalog, Feature Store, MLflow, and Model Serving • Collaborate with product and backend engineers on data models, APIs, and application data contracts • Consult with clients to understand data challenges, develop data strategies, and implement sustainable solutions • Lead client data architecture discussions or support internal teams with specialized data expertise • Work in AWS and Azure multi-cloud environments • Champion data governance, including access control, lineage, data quality policies, and compliance • Design data-to-application architectures involving Lakebase-backed services and Databricks Apps • Contribute to Livefront's Databricks practice, accelerators, internal enablement, certification goals, and partner go-to-market materials • Participate in a hiring process that may include a preliminary phone interview, video interviews, and a take-home exercise

🎯 Requirements

• 7-10 years of data engineering experience, including at least 5 years in production Databricks environments • Preferably experience in consulting or client delivery • Working knowledge of AWS and Azure services relevant to Databricks deployments, including storage, networking, IAM, and compute • Deep production-grade expertise with Lakeflow Declarative Pipelines, Autoloader, Structured Streaming, Lakeflow Jobs, and Unity Catalog • Experience designing production-scale Lakehouse architectures, including medallion patterns, Delta Lake table design, partitioning, Z-ordering, and query optimization • Experience with data pipeline testing, observability, and CI/CD, including unit testing, data quality frameworks, Git, and Declarative Automation Bundles • Strong proficiency in SQL and Python • Understanding of data modeling, schema design, and query optimization • Ability to explain complex data concepts to technical and non-technical stakeholders • Ability to navigate ambiguous requirements and deliver pragmatic solutions • Above-average discipline and personal organization • Comfort with critique and peer review • Hunger for personal and professional growth • Love and care for data engineering • Short note about yourself, summary of work experience, and link to actively maintained public profiles when applying

🏖️ Benefits

• Opportunity to work with passionate and talented people • Respectful, mutually trusting, egoless collaboration environment • Work on products and accounts with outsized impact and reach • Team reputation for excellence and community giving through educating, mentoring, and sponsoring • Opportunity to help build the Databricks practice from the ground up • Fast hiring process with video interviews and a take-home exercise of up to one week

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume