Senior Data Engineer

🕒 August 7

⚔️ Virginia – Remote

⚔️ Virginia – Remote

💵 $98.6k - $167.6k / year

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 28%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

ICF

WebsiteLinkedInAll Job Openings

5001 - 10000 employees

Founded 1969

💼 Consulting

🏛️ Government

🏥 Healthcare

💰 $29M Grant on 2023-03

Consulting • Government • Healthcare

ICF is a global consulting firm founded over 55 years ago that partners with governments, businesses, and communities to deliver data-driven, technology-enabled solutions for complex public- and private-sector challenges. Its work areas include digital modernization, data analytics, resilience and adaptation, energy planning, federal health programs, disaster management, and infrastructure and transportation support. ICF provides consulting, program implementation, and advisory services to drive measurable outcomes and build community resilience.

📋 Description

• Design, develop, and maintain scalable data pipelines using Spark, Hive, and Airflow • Develop and deploy data processing workflows on Databricks • Develop API services for data access and integration • Create interactive data visualizations and reports using AWS QuickSight • Build infrastructure for extracting, transforming, and loading data from various sources using AWS and SQL • Monitor and optimize data infrastructure and process performance • Develop data quality and validation jobs • Assemble complex datasets meeting functional and non-functional business requirements • Write unit and integration tests for data processing code • Collaborate with DevOps engineers on CI, CD, and IaC • Translate specifications into code and design documents • Perform code reviews and improve code quality processes • Improve data availability and timeliness through refreshes, tiered storage, and dataset optimization • Maintain data security and privacy at rest and in transit • Perform other duties as assigned

🎯 Requirements

• Bachelor's degree • 7+ years of hands-on software development experience • 4+ years of experience building data pipelines using Python, Java, and cloud technologies • Hands-on experience leveraging Spark and Hive for large-scale data processing • Must be able to obtain and maintain a Public Trust clearance • Must reside in the United States • Must be authorized to work in the United States • Work must be performed in the United States • Must have lived in the United States for 3 full years out of the last 5 years • Experience with Databricks job workflows preferred • Strong understanding of AWS products including S3, Redshift, RDS, EMR, AWS Glue, AWS Glue DataBrew, Jupyter Notebooks, Athena, QuickSight, and Amazon SNS preferred • Familiarity with data transformation, workload management, data structures, dependency, and metadata processes • Experience with data governance for batch and streaming ingestion, curation, and data sharing • Experience optimizing data systems and building them from the ground up • Experience with Cassandra and Postgres; Airflow, Luigi, and Azkaban; Spark Streaming and Storm; Scala, C++, Java, and Python • Familiarity with CI/CD pipelines using GitHub Actions and IaC using Terraform • Experience with Agile methodology and test-driven development

🏖️ Benefits

• Equal opportunity employer • Reasonable accommodations for disabilities, veteran status, and sincerely held religious beliefs • Confidential accommodation support • Benefits information provided under the Transparency in Coverage Act