Senior Data Engineer

🕒 Setembro 8

⚔️ Virginia – Remoto

⚔️ Virginia – Remote

💵 $156.423 - $179.191 / ano

⏰ Tempo Integral

🟠 Sênior

🚰 Engenheiro de Dados

👻 Score fantasma 7%

O que significa: quão provável esta vaga está aberta sem contratação ativa.Como ler: 60% ou mais significa que achamos que é uma vaga fantasma. Pontuações mais baixas preocupam menos.Como pontuamos: tempo em aberto, republicações, vagas abertas vs tamanho do time, rapidez para fechar vagas, e se o salário está divulgado.Observação: é uma estimativa de dados públicos, não um julgamento da empresa. Vagas reais podem ter pontuação alta, então use como uma dica, não como um fato.

Candidatar-se

Encontrar Vagas Remotas Similares

Configurar Alerta de Email para Novas Vagas

📊 Verifique sua pontuação de currículo para esta vaga

Melhore suas chances de conseguir uma entrevista verificando sua pontuação de currículo antes de se candidatar.

Enviar Currículo

Systems Planning & Analysis

SiteLinkedInTodas as Vagas

1001 - 5000 funcionários

📦 Logística

🏥 Saúde

💼 Consultoria

Logistics • Healthcare • Consulting

A Systems Planning & Analysis é uma empresa dedicada a apoiar iniciativas de segurança nacional por meio de análise inovadora e orientada por dados e serviços de engenharia. Com mais de 50 anos de experiência, a SPA concentra-se em áreas como inteligência de defesa e segurança interna, fornecendo expertise técnica e metodologias avançadas, incluindo IA e aprendizado de máquina. Suas capacidades abrangem desenvolvimento de software, engenharia de sistemas, análise de decisões e modelagem para resolver de forma eficaz desafios complexos enfrentados por clientes governamentais.

Descrição

• Design, develop, and maintain scalable, production-ready data pipelines and data products using Spark (Python/SQL) in a Databricks environment • Lead the integration and transformation of complex data from diverse DoW and federal health systems and sources into reliable, reusable data products • Design scalable approaches for data ingestion, integration, and exchange, including API-based integrations and services • Establish and promote reusable data engineering patterns, standards, and best practices • Provide technical guidance on data architecture, pipeline design, data modeling, integration approaches, and engineering practices • Monitor, troubleshoot, and optimize production workflows and data pipelines • Define and implement data validation, quality, and governance practices • Troubleshoot complex technical and data integration challenges, identify root causes, and drive sustainable solutions • Collaborate with engineers, architects, analysts, and customer stakeholders to translate complex data needs into scalable technical solutions • Provide technical guidance and mentorship to other engineers • Identify opportunities to improve engineering tools, processes, and patterns and help drive adoption • Take ownership of complex technical areas and maintain engineering quality, consistency, and cohesion as the platform and portfolio of data products grow

🎯 Requisitos

• Master’s degree in Computer Science, Information Systems, Software Engineering, or a related field • 10+ years of data engineering, software engineering, or related technical experience • Extensive hands-on experience designing, building, and operating production data pipelines and data products • Advanced proficiency with Python and SQL • Strong experience with Apache Spark and distributed data processing • Experience working with Databricks or similar modern data platforms • Experience designing and maintaining ETL/ELT processes for complex, large-scale datasets • Experience troubleshooting and optimizing complex production data pipelines for performance, reliability, and scalability • Experience working with Git-based development workflows and modern software engineering practices • Demonstrated experience providing technical guidance, mentoring engineers, and influencing engineering practices • Strong client and stakeholder communication skills, with the ability to translate technical concepts and recommendations for both technical and non-technical audiences • Ability to independently navigate ambiguity, identify technical risks, and drive complex engineering challenges toward resolution • Experience spotting security, privacy and compliance issues and working with security/compliance/legal stakeholders • Possess and maintain an active Secret clearance • AWS cloud experience • Experience working with very large datasets, including datasets with billions of records • Experience with Palantir Foundry • GitLab experience • Experience working with Advana or similar DoW data environments • Experience working with federal health, financial, or other regulated and sensitive data • Experience using AI/ML to accelerate work, including automating routine tasks, accelerating development and debugging

🏖️ Benefícios

• Competitive base pay • Variable compensation opportunities • Health insurance • Flexible spending accounts • Health savings accounts • Retirement savings plans • Life and disability insurance programs • Paid and unpaid time away from work