Senior Data Engineer

🔥 0 minutes ago

⚔️ Virginia – Remote

⚔️ Virginia – Remote

💵 $89.6k - $152.4k / year

⏰ Full Time

🟠 Senior

🚰 Data Engineer

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

ICF

WebsiteLinkedInAll Job Openings

5001 - 10000 employees

Founded 1969

💼 Consulting

🏛️ Government

🏥 Healthcare

💰 $29M Grant on 2023-03

Consulting • Government • Healthcare

ICF is a global consulting firm founded over 55 years ago that partners with governments, businesses, and communities to deliver data-driven, technology-enabled solutions for complex public- and private-sector challenges. Its work areas include digital modernization, data analytics, resilience and adaptation, energy planning, federal health programs, disaster management, and infrastructure and transportation support. ICF provides consulting, program implementation, and advisory services to drive measurable outcomes and build community resilience.

📋 Description

• Design, develop, and maintain scalable data pipelines using Spark, Hive, and Airflow • Develop and deploy data processing workflows on Databricks • Develop API services for data access and integration • Create interactive data visualizations and reports using AWS QuickSight • Build infrastructure for extraction, transformation, and loading of data using AWS and SQL technologies • Monitor and optimize data infrastructure and process performance • Develop data quality and validation jobs • Assemble complex datasets meeting functional and non-functional business requirements • Write unit and integration tests for data processing code • Collaborate with DevOps engineers on CI, CD, and IaC • Translate specifications into code and design documents • Perform code reviews and improve code quality processes • Improve data availability and timeliness through refreshes, tiered storage, and dataset optimization • Maintain data security and privacy at rest and in transit • Perform other duties as assigned

🎯 Requirements

• Bachelor's degree • 7+ years of hands-on software development experience • 4+ years of experience building data pipelines using Python, Java, and cloud technologies • Hands-on experience with Spark and Hive for large-scale data processing • Must be able to obtain and maintain a Public Trust clearance • Must reside in the United States • Must be authorized to work in the United States • Work must be performed in the United States • Must have lived in the United States for 3 full years out of the last 5 years • Preferred: experience building workflows with Databricks • Preferred: strong understanding of AWS products including S3, Redshift, RDS, EMR, AWS Glue, AWS Glue DataBrew, Jupyter Notebooks, Athena, QuickSight, and Amazon SNS • Preferred: familiarity with data transformation, workload management, data structures, dependency, and metadata processes • Preferred: experience with data governance for batch and streaming ingestion, curation, and data sharing • Preferred: experience optimizing and building data pipeline systems • Preferred: understanding of Cassandra, Postgres, Airflow, Luigi, Azkaban, Spark Streaming, Storm, Scala, C++, Java, and Python • Preferred: familiarity with CI/CD pipelines using GitHub Actions and IaC using Terraform • Preferred: experience with Agile methodology and test-driven development

🏖️ Benefits

• Equal opportunity employer • Reasonable accommodations throughout the application and employment process • Benefit offerings referenced under the Transparency in Coverage Act