Databricks Solution Architect

🕒 Junho 16

🇺🇸 Estados Unidos – Remoto (EUA)

💵 $102.000 - $133.000 / ano

⏰ Tempo Integral

🟠 Sênior

🔴 Especialista

💻 Engenheiro de Soluções

🦅 Patrocina Visto H1B

Esta empresa já patrocinou vistos H1B no passado.

Candidatar-se

Encontrar Vagas Remotas Similares

Configurar Alerta de Email para Novas Vagas

📊 Verifique sua pontuação de currículo para esta vaga

Melhore suas chances de conseguir uma entrevista verificando sua pontuação de currículo antes de se candidatar.

Enviar Currículo

Bounteous

SiteLinkedInTodas as Vagas

501 - 1000 funcionários

Fundada em 2003

💼 Consultoria

🏥 Saúde

📣 Marketing

💰 Private Equity Round em 2021-08

Consulting • Healthcare • Marketing

A Bounteous é uma empresa de soluções digitais conhecida por seu modelo de co-inovação, o qual auxilia marcas líderes a navegar transformações digitais e aprimorar experiências de usuário. A empresa faz parcerias com negócios de diversos setores, como serviços financeiros, saúde, telecomunicações, varejo, e conveniência, para oferecer soluções baseadas em dados. A Bounteous oferece expertise em áreas como inteligência artificial, análise de dados, comércio digital e habilitação em nuvem, ajudando seus clientes a aproveitarem a tecnologia para um crescimento sustentável e fidelidade à marca. Com presença global, a Bounteous é dedicada a criar estratégias digitais personalizadas e eficazes que impulsionam o sucesso nos negócios.

Descrição

• Architect and lead the implementation of an enterprise lakehouse on Databricks (Delta Lake, Unity Catalog, Photon, Workflows) across one or more major clouds (AWS, Azure, or GCP). • Design scalable batch and streaming data pipelines using PySpark, Spark SQL, Structured Streaming, and Delta Live Tables; establish patterns for ingestion from operational systems, event streams, and third-party APIs. • Define and enforce platform standards for data modeling (medallion architecture), CI/CD, code quality, testing, observability, and cost optimization. • Lead the governance strategy using Unity Catalog — fine-grained access control, data lineage, audit, and PII handling — in partnership with security and compliance. • Optimize Spark workloads for performance and cost: cluster sizing, Photon, autoscaling, file layout, Z-ordering, caching, and query tuning. • Partner with ML engineers and data scientists to operationalize models using MLflow, feature stores, and model serving on Databricks. • Own the cloud infrastructure footprint for the platform: networking, IAM, secrets, encryption, and Terraform/IaC for Databricks workspaces and supporting services. • Mentor a team of data engineers; lead architecture reviews, code reviews, and technical design sessions; raise the bar on engineering practices. • Engage with stakeholders across analytics, product, and finance to translate business needs into a roadmap for the data platform.

🎯 Requisitos

• 8+ years of data engineering experience, with 4+ years building production workloads on Databricks. • Deep expertise in Apache Spark (PySpark and Spark SQL) — including performance tuning, partitioning strategy, and the Catalyst/Photon execution model. • Strong hands-on experience with Delta Lake, Unity Catalog, Databricks Workflows, and Delta Live Tables. • Production experience on at least one major cloud (AWS, Azure, or GCP), including networking, IAM, storage (S3/ADLS/GCS), and compute primitives. • Proficiency in Python and SQL; comfort with Scala is a plus. • Experience designing medallion (bronze/silver/gold) architectures and dimensional models for analytics. • Strong CI/CD and DevOps practice: Git, Terraform, Databricks Asset Bundles or dbx, automated testing of data pipelines. • Track record of leading technical projects end-to-end and mentoring engineers. • Excellent written and verbal communication; able to drive alignment with both engineering and business stakeholders.

🏖️ Benefícios

• Bounteous is proud to be an equal opportunity employer. • Bounteous does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, physical or mental disability, national origin, veteran status, or any other status protected under federal, state, or local law. • Bounteous is willing to sponsor eligible candidates for employment visas.