Senior Data Engineer

🕒 Outubro 5

🇺🇸 Estados Unidos – Remoto (EUA)

⏰ Tempo Integral

🟠 Sênior

🚰 Engenheiro de Dados

👻 Score fantasma 14%

O que significa: quão provável esta vaga está aberta sem contratação ativa.Como ler: 60% ou mais significa que achamos que é uma vaga fantasma. Pontuações mais baixas preocupam menos.Como pontuamos: tempo em aberto, republicações, vagas abertas vs tamanho do time, rapidez para fechar vagas, e se o salário está divulgado.Observação: é uma estimativa de dados públicos, não um julgamento da empresa. Vagas reais podem ter pontuação alta, então use como uma dica, não como um fato.

Candidatar-se

Encontrar Vagas Remotas Similares

Configurar Alerta de Email para Novas Vagas

📊 Verifique sua pontuação de currículo para esta vaga

Melhore suas chances de conseguir uma entrevista verificando sua pontuação de currículo antes de se candidatar.

Enviar Currículo

Seneca Holdings

SiteLinkedInTodas as Vagas

501 - 1000 funcionários

💼 Consultoria

🏥 Saúde

📦 Logística

Consulting • Healthcare • Logistics

Seneca Holdings é uma empresa holding diversificada que investe em uma variedade de setores, incluindo tecnologia, saúde e energia. Com foco no crescimento a longo prazo e na criação de valor, a Seneca Holdings busca identificar e cultivar oportunidades em seus investimentos, impulsionando a inovação e a eficiência.

Descrição

• Design, build, and maintain scalable data pipelines within a Databricks E2 environment hosted on AWS • Analyze and collect data from relational databases, APIs, external data providers, and real-time streaming sources • Design and implement pipelines to cleanse, transform, and aggregate data for reporting and analytics • Build and maintain Databricks medallion architecture using Bronze, Silver, and Gold layers • Develop source-to-target mapping documentation and conduct unit testing • Write advanced SQL aggregations and analyze data for anomalies, quality issues, and inconsistencies • Implement real-time and near-real-time ingestion using AWS DMS and other AWS-native services • Develop data-processing logic using Python and/or R with Spark, PySpark, and Pandas • Manage source code, versioning, and deployments using GitLab and CI/CD pipelines • Collaborate with cross-functional teams in an Agile project environment • Ensure alignment with FISMA High and multi-tenant security, governance, and compliance requirements • Leverage AI automation tools for pipeline development, testing, validation, and delivery

🎯 Requisitos

• Proven, hands-on experience as a Data Engineer or Databricks Developer building production-grade data pipelines • Strong working knowledge of Databricks on AWS, including E2 architecture, cluster configuration, job orchestration, and workspace management • Hands-on experience with Apache Spark, PySpark, and Pandas for large-scale, distributed data processing • Solid programming skills in Python; working knowledge of R is a plus • Experience with Databricks Auto Loader for scalable, incremental file ingestion • Practical experience with AWS Database Migration Service (DMS) for change data capture and real-time data replication • Strong experience with Delta Lake and Delta tables, including schema evolution, time travel, OPTIMIZE, Z-ORDER, and VACUUM • Experience with Amazon RDS and other relational database sources used in data extraction and integration workflows • Advanced SQL skills, including complex joins, window functions, aggregations, and performance tuning • Solid understanding of medallion architecture and modern data lakehouse design principles • Experience with GitLab and CI/CD pipelines for automated testing, build, and deployment of data engineering code • Experience working in Agile/Scrum project environments

🏖️ Benefícios

• Competitive pay • Medical, dental, vision, life, and disability benefits • Voluntary critical illness, hospital, and accident benefits • Health savings and flexible spending accounts • Retirement 401K plan • Paid leave programs • Flexible work-life balance • Professional development opportunities • Performance and recognition programs • Collaborative work environment • Financial and non-financial benefits for Seneca Nation members