Data Engineer

Vaga não está no LinkedIn

🕒 Janeiro 29

Candidatar-se

Encontrar Vagas Remotas Similares

Receber Emails de Vagas Remotas

📊 Verifique sua pontuação de currículo para esta vaga

Melhore suas chances de conseguir uma entrevista verificando sua pontuação de currículo antes de se candidatar.

Enviar Currículo

Cybermedia Technologies, LLC (CTEC)

SiteLinkedInTodas as Vagas

201 - 500 funcionários

Fundada em 1996

🔒 Cibersegurança

Cybersecurity • Cloud • IT Modernization

A Cybermedia Technologies, LLC (CTEC) é uma empresa dedicada à modernização de infraestruturas de TI legadas e à proteção de sistemas críticos para órgãos federais. Com mais de 25 anos de experiência, a CTEC é especializada em modernização de TI, serviços de nuvem e cibersegurança, além de soluções de treinamento de força de trabalho que melhoram a adoção de tecnologia e a eficiência nas operações governamentais. Sua abordagem inovadora se concentra em entregar design centrado no ser humano para impactar milhões de funcionários federais e cidadãos americanos diariamente.

Descrição

• Design, develop, and maintain scalable ETL pipelines and data workflows. • Build, optimize, and maintain data processing solutions using Azure Databricks. • Support phased data migration from legacy databases and ETL tools. • Implement layered lakehouse data architectures in Databricks. • Develop data processing notebooks, workflows, and distributed data transformations using Python and PySpark. • Develop data validation, reconciliation, and testing processes. • Integrate Databricks data platforms with analytics and reporting tools. • Support data governance initiatives including metadata management. • Maintain source control and CI/CD pipelines for Databricks workflows. • Provide ongoing support for Databricks workflows and troubleshoot complex issues. • Provide guidance to junior data engineers and contribute to documentation and team enablement.

🎯 Requisitos

• At least seven (7–9+) years of experience in data engineering, ETL development, or large-scale data integration environments. • Strong experience designing and developing ETL pipelines and data transformations in Azure Databricks environments. • Strong proficiency in SQL and Python, with hands-on experience using PySpark for distributed data processing. • Experience working with cloud-based data platforms, data lakes, and lakehouse environments, preferably on Microsoft Azure. • Experience implementing layered lakehouse data architectures (bronze, silver, gold) for enterprise analytics. • Familiarity with Spark-based big data processing frameworks. • Experience supporting data migration from legacy databases and ETL tools to Databricks-based platforms. • Experience integrating Databricks platforms with business intelligence and reporting tools such as Power BI. • Familiarity with data governance, metadata management, and data security best practices. • Experience with source control and CI/CD pipelines for data engineering and Databricks workflows. • Working knowledge of SDLC and Agile delivery methodologies. • Excellent organizational, communication, and collaboration skills.

🏖️ Benefícios

• Paid vacation & Sick leave • Health insurance coverage • Career training • Performance bonus programs • 401K contribution & Employer Match • 11 Federal Holidays