Senior Data Engineer

🕒 Julho 27

🇺🇸 Estados Unidos – Remoto (EUA)

💵 $130.000 - $165.000 / ano

⏰ Tempo Integral

🟠 Sênior

🚰 Engenheiro de Dados

👻 Score fantasma 23%

O que significa: quão provável esta vaga está aberta sem contratação ativa.Como ler: 60% ou mais significa que achamos que é uma vaga fantasma. Pontuações mais baixas preocupam menos.Como pontuamos: tempo em aberto, republicações, vagas abertas vs tamanho do time, rapidez para fechar vagas, e se o salário está divulgado.Observação: é uma estimativa de dados públicos, não um julgamento da empresa. Vagas reais podem ter pontuação alta, então use como uma dica, não como um fato.

Candidatar-se

Encontrar Vagas Remotas Similares

Configurar Alerta de Email para Novas Vagas

📊 Verifique sua pontuação de currículo para esta vaga

Melhore suas chances de conseguir uma entrevista verificando sua pontuação de currículo antes de se candidatar.

Enviar Currículo

Capital Technology Group, LLC

SiteLinkedInTodas as Vagas

11 - 50 funcionários

Fundada em 2010

💼 Consultoria

📦 Logística

🎖️ Defesa

Consulting • Logistics • Defense

A Capital Technology Group é uma empresa de tecnologia especializada em resolver problemas complexos de negócios por meio de serviços digitais. Ela oferece uma gama de serviços profissionais de TI, incluindo integração de dados, desenvolvimento de aplicações personalizadas, transformação digital e segurança da informação. Sua expertise abrange a modernização de processos legados, implementação de pipelines automatizados de DevSecOps e uso de técnicas de ciência de dados para derivar insights acionáveis a partir de big data. A empresa foca especialmente em atender clientes do governo federal, assegurando serviços de alta qualidade que aumentam a eficiência operacional.

Descrição

• CTG is seeking a Senior Data Engineer to design, build, and maintain scalable, efficient data pipelines and systems following modern data engineering best practices. • Design, build, and maintain scalable data pipelines, ETL/ELT workflows, and data models using Python, Apache Spark (PySpark), Databricks, dbt, SQL (PostgreSQL), and AWS Glue. • Develop and optimize AWS-native data platforms leveraging AWS Glue, Amazon EMR, Amazon MWAA (Apache Airflow), Lambda, Step Functions, Amazon S3, Redshift, RDS, DMS, and CloudWatch. • Build high-performance ingestion, transformation, and orchestration workflows for structured and semi-structured data using Apache Iceberg, Parquet, ORC, and Avro. • Design and optimize analytical data platforms using Amazon Athena, Trino, Hive, OpenSearch, and enterprise data catalog technologies. • Integrate enterprise and external data sources across relational and NoSQL platforms including PostgreSQL, Oracle, Redshift, GraphDB, and other NoSQL databases. • Build AI-enabled data solutions using Amazon Bedrock, RAG pipelines, and vector search technologies including Amazon S3 Vector and OpenSearch vector indexes. • Develop cloud infrastructure using CloudFormation (Infrastructure as Code), GitHub, Harness, and enterprise CI/CD pipelines while leveraging SNS, SQS, and EventBridge for event-driven architectures. • Improve the reliability, scalability, performance, and maintainability of enterprise data platforms through monitoring, troubleshooting, automation, and continuous optimization. • Support mission-critical analytics and reporting solutions within large-scale AWS-based federal data environments, implementing solutions that comply with FedRAMP and NIST 800-53 security controls. • Lead modernization initiatives migrating legacy platforms including IBM DataStage, Hadoop, RunDeck, and shell-based workflows to cloud-native AWS services. • Mentor junior engineers through technical guidance, architecture discussions, and code reviews while promoting engineering best practices. • Collaborate with cross-functional teams in an Agile environment to define requirements, deliver high-quality data solutions, and communicate technical concepts effectively to technical and non-technical stakeholders.

🎯 Requisitos

• Bachelor's degree in Computer Science, Engineering, or a related technical field • 9+ years of professional experience in data engineering or related domains • Strong hands-on experience with: Databricks, Apache Spark (PySpark), Python, SQL (PostgreSQL), and dbt for large-scale data engineering, ETL/ELT development, data transformation, and data modeling. • Designing, building, and maintaining AWS-native data platforms using AWS Glue, Amazon EMR, Amazon MWAA (Apache Airflow), AWS Lambda, AWS Step Functions, Amazon S3, Amazon Redshift, Amazon RDS, AWS DMS, and Amazon CloudWatch. • Developing scalable data pipelines, workflow orchestration, and data integration solutions across enterprise environments. • Working with modern data lake technologies including Apache Iceberg and data formats such as Parquet, ORC, and Avro. • Designing and optimizing solutions using relational and NoSQL databases including PostgreSQL, Redshift, Oracle, GraphDB, and other NoSQL platforms. • Building reliable, high-performance data platforms through performance tuning, system optimization, and enterprise-scale ETL/ELT architectures. • Java development and modern CI/CD practices using Harness. • Strong analytical and problem-solving skills • Experience working in agile, iterative software development environments • Ability to quickly learn and apply new technologies and domain knowledge • Excellent written and verbal communication skills, with the ability to explain complex topics to diverse audiences.

🏖️ Benefícios

• Remote Work (Hybrid roles will be specified in the job post) • Competitive Compensation Package • Medical, Dental, and Vision • Life Insurance, Short/Long Term Disability • Employee Assistance Program • 401(k) with 4% matching • Liberal PTO vacation policy • Generous Annual Continuing Education • Annual Wellness Budget • Bonus Incentive Programs (Employee referrals and performance-based rewards)