Senior Data Engineer

Job not on LinkedIn

🔥 1 minute ago

🇺🇸 United States – Remote

💵 $89.6k - $152.4k / year

⏰ Full Time

🟠 Senior

🚰 Data Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

ICF

WebsiteLinkedInAll Job Openings

5001 - 10000 employees

Founded 1969

🏥 Healthcare

📦 Logistics

📣 Marketing

💰 $30M Grant on 2021-03

Healthcare • Logistics • Marketing

ICF is a global consulting and technology services company that helps government and commercial clients tackle complex challenges. The firm provides expertise in areas such as Federal IT modernization, energy and utilities, public health, climate resilience, disaster management, and transportation. ICF leverages data and analytics, artificial intelligence, and cybersecurity to deliver innovative solutions. With a strong commitment to corporate citizenship and sustainability, ICF supports social programs and community development, aiming for a sustainable, low-emissions future. The company operates worldwide, with significant presence in Europe through its offices in Belgium, Spain, and the UK.

📋 Description

• Design, develop, and maintain scalable data pipelines using Spark, Hive, and Airflow • Develop and deploy data processing workflows on Databricks • Develop API services for data access and integration • Create interactive data visualizations and reports using AWS QuickSight • Build infrastructure for extraction, transformation, and loading of data from various sources using AWS and SQL • Monitor and optimize data infrastructure and process performance • Develop data quality and validation jobs • Assemble complex datasets meeting functional and non-functional business requirements • Write unit and integration tests for data-processing code • Collaborate with DevOps engineers on CI, CD, and IaC • Translate specifications into code and design documents • Perform code reviews and improve code quality processes • Improve data availability and timeliness through refreshes, tiered storage, and dataset optimization • Maintain data security and privacy at rest and in transit • Perform other assigned duties

🎯 Requirements

• Bachelor's degree • 7+ years of hands-on software development experience • 4+ years building data pipelines with Python, Java, and cloud technologies • Hands-on experience with Spark and Hive for large-scale data processing • Must be able to obtain and maintain a Public Trust clearance • Must reside in the US and be authorized to work in the US • Work must be performed in the US • Must have lived in the US 3 full years out of the last 5 years • Experience with Databricks job workflows • Strong understanding of AWS products including S3, Redshift, RDS, EMR, AWS Glue, AWS Glue DataBrew, Jupyter Notebooks, Athena, QuickSight, and Amazon SNS • Familiarity with data transformation, workload management, data structures, dependency, and metadata processes • Experience with data governance for batch and streaming ingestion, curation, and data sharing • Experience building and optimizing data pipelines and data systems • Experience with Cassandra, Postgres, relational, NoSQL, and SQL databases • Experience with Airflow, Luigi, and Azkaban • Experience with Spark Streaming and Storm • Experience with Scala, C++, Java, and Python • Familiarity with CI/CD pipelines, GitHub Actions, and Terraform IaC • Ability to obtain and maintain a Public Trust while residing in the United States • Experience with Agile methodology and test-driven development

🏖️ Benefits

• Equal opportunity employer • Reasonable accommodations available for disabled veterans, individuals with disabilities, and individuals with sincerely held religious beliefs • Confidential accommodation support • Full-time employment pay range of $89,649.00–$152,404.00