Senior Data Engineer

Vaga não está no LinkedIn

🕒 Setembro 11

🇺🇸 Estados Unidos – Remoto (EUA)

💵 $115.000 - $165.000 / ano

⏰ Tempo Integral

🟠 Sênior

🚰 Engenheiro de Dados

👻 Score fantasma 7%

O que significa: quão provável esta vaga está aberta sem contratação ativa.Como ler: 60% ou mais significa que achamos que é uma vaga fantasma. Pontuações mais baixas preocupam menos.Como pontuamos: tempo em aberto, republicações, vagas abertas vs tamanho do time, rapidez para fechar vagas, e se o salário está divulgado.Observação: é uma estimativa de dados públicos, não um julgamento da empresa. Vagas reais podem ter pontuação alta, então use como uma dica, não como um fato.

Candidatar-se

Encontrar Vagas Remotas Similares

Configurar Alerta de Email para Novas Vagas

📊 Verifique sua pontuação de currículo para esta vaga

Melhore suas chances de conseguir uma entrevista verificando sua pontuação de currículo antes de se candidatar.

Enviar Currículo

Imagine Believe Realize, LLC.

SiteLinkedInTodas as Vagas

201 - 500 funcionários

Fundada em 2007

🏛️ Governo

🔒 Cibersegurança

Government • Cybersecurity

A Imagine Believe Realize, LLC é uma empresa de serviços de engenharia de software e sistemas fundada em 2007, que fornece soluções técnicas para clientes dos setores público e privado. A IBR é especializada em engenharia de software (Agile/Scrum, designs N-tier, liderança de SDLC corporativa), engenharia de sistemas (TOGAF, DoDAF, arquitetura corporativa), computação em nuvem, cibersegurança (avaliações, DevSecOps, vCISO, resposta a incidentes, certificada em CMMC), gerenciamento de identidade, credenciais e acesso (ICAM) para o DoD e clientes federais, soluções de mobilidade (BYOD, desenvolvimento móvel), customização de Salesforce, software de Sistemas de Informação Geográfica (GIS) para o U. S. Census Bureau, e performance/escalabilidade para ambientes de computação de alto desempenho. Possui veículos de contrato governamentais e certificações e se posiciona como um contratante focado em missões, atendendo clientes federais, incluindo o DoD, Marinha e o U. S. Census Bureau.

Descrição

• Design and implement secure, next-generation data engineering solutions supporting critical missions • Collaborate with technical leaders, business stakeholders, and multidisciplinary teams • Support implementation of the DON MAHRS program Data Strategy and High-Level Total Force Data Hub implementation plan • Develop, implement, integrate, and sustain data architectures, data hubs, data lakes, and data warehouses • Design and develop data models, data structures, and data acquisition processes • Develop engineering and implementation plans for data hubs, acquisition, modeling, integration, and related activities • Research and evaluate data sources to identify authoritative and reliable sources for data hub development • Plan, create, and maintain data architectures aligned with business requirements • Design, develop, maintain, and optimize ETL/ELT pipelines and transformation processes • Develop and maintain batch and streaming pipelines using Spark, Python, Databricks, Palantir Foundry, Kafka, and related tools • Develop data acquisition processes to ingest, transform, validate, and integrate enterprise data • Implement incremental loading, late-arriving data, processing-window, data-freshness, and lifecycle approaches • Automate manual data processes and improve workflow efficiency, reliability, and scalability • Develop, maintain, and optimize solutions within Databricks and enterprise data lakes • Configure, monitor, manage, and document Databricks clusters according to DON policies and security requirements • Develop and maintain Spark solutions using PySpark, Spark SQL, DataFrames, and Data Sets • Implement and maintain Delta Lake and Delta Live Tables solutions • Optimize data processing, storage, and query performance • Support Palantir Foundry ontologies, ETL/ELT pipelines, applications, and data-driven user interfaces • Integrate Palantir Foundry with enterprise data engineering and analytics environments • Develop and maintain streaming solutions using Kafka, Kafka Streams, and ksqlDB • Configure and manage Kafka topics and Schema Registry • Develop Python data-processing applications and AWS Lambda functions • Support processing with AWS S3, Kinesis, Lambda, and DynamoDB • Monitor, troubleshoot, and optimize cloud-based processing solutions • Develop data quality controls, validation processes, and data quality gates • Develop and execute data-driven and unit testing for Spark, Python, and other processing solutions • Establish data lifecycle policies covering retention, backup, recovery, and data management • Monitor and troubleshoot pipelines and processing jobs • Improve performance, reliability, scalability, and maintainability

🎯 Requisitos

• 5+ years of professional data engineering related experience • 5+ years of IT experience focusing on enterprise data engineering, including data modeling, data quality, data mapping tools, and technical documentation • Bachelor’s degree in Computer Science, Engineering, Mathematics, Statistics, or an IT-related field • Must be eligible to obtain and maintain a Secret security clearance • United States citizenship required to obtain this type of security clearance • Candidates must reside in the continental United States • Professional experience in data architecture, data engineering, data hub, data lake, and/or data warehouse development • Experience designing, developing, implementing, and supporting enterprise-scale data engineering solutions • Experience with data modeling, data mapping, data quality, data integration, and data management • Experience supporting large-scale, high-performance enterprise data applications • Experience developing and supporting ETL/ELT data pipelines and data transformation processes • Hands-on experience with Databricks required • Experience with Python and SQL for data engineering and data processing • Experience with Apache Spark and/or PySpark, including Spark SQL, DataFrames, and/or Data Sets preferred • Experience supporting data integration, migration, transformation, data warehouse, data hub, and/or data lake/Delta Lake implementations • Experience with batch and streaming data processing architectures • Experience with Kafka and/or other distributed streaming technologies • Experience developing and supporting Kafka Streams • Experience working in an AWS cloud environment, including S3, Lambda, Kinesis, and/or DynamoDB • Experience with Git-based version control, including branching, merging, pull requests, and repository management • Experience supporting CI/CD pipelines and cloud monitoring with Jenkins, Docker, and/or CloudWatch preferred • Experience with Palantir Foundry preferred • Experience with the Jupiter data and analytics environment preferred but not required • Ability to debug, troubleshoot, design, and implement solutions to complex technical issues • Ability to thrive in a team-based environment • Experience briefing technology solutions to technology partners, stakeholders, team members, and senior-level management • Strong written and verbal communication • Active CompTIA Security+ or CompTIA Network+ certification preferred; if selected, must obtain CompTIA Security+ before supporting the program

🏖️ Benefícios

• Nationwide medical, dental, and vision insurance • 3 weeks of Paid Time Off • 11 Paid Federal Holidays • 401k matching • Life Insurance • Short-Term Disability at no cost to employees • Long-Term Disability at no cost to employees • Supplemental insurance options • Flexible spending accounts • Dependent Care spending accounts • Wellness incentives • Reimbursement for professional development and certifications • Training assistance opportunities to support career growth and progression • Flexible scheduling options • Hybrid and Remote work opportunities to support work-life balance