Lead Data Engineer

🔥 0 minutes ago

🇺🇸 United States – Remote

💵 $150k - $200k / year

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 12%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Capital Technology Group, LLC

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2010

💼 Consulting

📦 Logistics

🎖️ Defense

Consulting • Logistics • Defense

Capital Technology Group is a technology firm that specializes in solving complex business problems through digital services. They offer a range of IT professional services including data integration, custom application development, digital transformation, and information security. Their expertise encompasses modernizing legacy processes, implementing automated DevSecOps pipelines, and using data science techniques to derive actionable insights from big data. The company is particularly focused on serving federal government clients, ensuring high-quality services that enhance operational efficiency.

📋 Description

• Design, build, and maintain scalable data pipelines, ETL/ELT workflows, and data models • Develop and optimize AWS-native data platforms using AWS Glue, Amazon EMR, Amazon MWAA (Apache Airflow), Lambda, Step Functions, Amazon S3, Redshift, RDS, DMS, and CloudWatch • Build high-performance ingestion, transformation, and orchestration workflows for structured and semi-structured data • Design and optimize analytical data platforms using Amazon Athena, Trino, Hive, OpenSearch, and enterprise data catalog technologies • Integrate enterprise and external data sources across relational and NoSQL platforms • Build AI-enabled data solutions using Amazon Bedrock, RAG pipelines, and vector search technologies • Develop cloud infrastructure using CloudFormation, GitHub, Harness, CI/CD pipelines, SNS, SQS, and EventBridge • Improve reliability, scalability, performance, and maintainability through monitoring, troubleshooting, automation, and continuous optimization • Support mission-critical analytics and reporting solutions in AWS-based federal data environments complying with FedRAMP and NIST 800-53 controls • Lead modernization initiatives migrating IBM DataStage, Hadoop, RunDeck, and shell-based workflows to cloud-native AWS services • Mentor junior engineers through technical guidance, architecture discussions, and code reviews • Collaborate with cross-functional teams in an Agile environment to define requirements, deliver data solutions, and communicate technical concepts

🎯 Requirements

• Applicants must be US Citizens and be able to obtain Public Trust clearance • Bachelor's degree in Computer Science, Engineering, or a related technical field • 15+ years of professional experience in data engineering or related domains • Strong hands-on experience with Apache Spark (PySpark), Python, SQL (PostgreSQL), and dbt • Strong hands-on experience with AWS Glue, Amazon EMR, Amazon MWAA (Apache Airflow), AWS Lambda, AWS Step Functions, Amazon S3, Amazon Redshift, Amazon RDS, AWS DMS, and Amazon CloudWatch • Experience developing scalable data pipelines, workflow orchestration, and data integration solutions across enterprise environments • Experience with Apache Iceberg, Parquet, ORC, and Avro • Experience designing and optimizing solutions using PostgreSQL, Redshift, Oracle, GraphDB, and NoSQL platforms • Experience with performance tuning, system optimization, and enterprise-scale ETL/ELT architectures • Java development and modern CI/CD practices using Harness • Strong analytical and problem-solving skills • Experience working in agile, iterative software development environments • Ability to quickly learn and apply new technologies and domain knowledge • Excellent written and verbal communication skills, with the ability to explain complex topics to diverse audiences

🏖️ Benefits

• Remote Work (Hybrid roles will be specified in the job post) • Competitive Compensation Package • Medical, Dental, and Vision • Life Insurance, Short/Long Term Disability • Employee Assistance Program • 401(k) with 4% matching • Liberal PTO vacation policy • Generous Annual Continuing Education • Annual Wellness Budget • Bonus Incentive Programs (Employee referrals and performance-based rewards)