Senior Databricks Platform Engineer

Job not on LinkedIn

🔥 0 minutes ago

⚔️ Virginia – Remote

⚔️ Virginia – Remote

💵 $98.6k - $202.8k / year

⏰ Full Time

🟠 Senior

🏗️ Platform Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

ICF

WebsiteLinkedInAll Job Openings

5001 - 10000 employees

Founded 1969

🏥 Healthcare

📦 Logistics

📣 Marketing

💰 $30M Grant on 2021-03

Healthcare • Logistics • Marketing

ICF is a global consulting and technology services company that helps government and commercial clients tackle complex challenges. The firm provides expertise in areas such as Federal IT modernization, energy and utilities, public health, climate resilience, disaster management, and transportation. ICF leverages data and analytics, artificial intelligence, and cybersecurity to deliver innovative solutions. With a strong commitment to corporate citizenship and sustainability, ICF supports social programs and community development, aiming for a sustainable, low-emissions future. The company operates worldwide, with significant presence in Europe through its offices in Belgium, Spain, and the UK.

📋 Description

• Design, configure, and operate Azure Databricks workspaces, clusters, jobs, workflows, catalogs, storage credentials, external locations, and service principals • Build and optimize batch and real-time ingestion and transformation pipelines • Implement medallion architecture, dimensional models, change data capture, schema evolution, data quality checks, retry and rollback mechanisms, and reproducible processing patterns • Configure Unity Catalog governance and secure integrations with ADLS Gen2 and approved storage • Develop frameworks and interfaces for AI and analytics teams to access governed training, inference, and reporting data • Automate Databricks deployments and environment configuration using infrastructure-as-code and CI/CD tools • Integrate Databricks with Azure Data Factory, Kafka, Airflow, APIs, Snowflake, Synapse, and other enterprise data services • Monitor pipeline, cluster, and workspace health; diagnose performance and data issues; and support root cause analysis • Support security, ATO, vulnerability remediation, business continuity, disaster recovery, and operational readiness activities • Participate in Agile planning, code reviews, demos, and retrospectives • Document architecture, runbooks, data models, governance decisions, and deployment procedures in version-controlled repositories • Explain architecture, trade-offs, risks, and operational impacts to technical and nontechnical stakeholders • Collaborate across data engineering, AI, cloud, security, application, and operations teams

🎯 Requirements

• BA/BS/MS in Computer Science, Engineering, Data Science, or equivalent experience • More than 5 years of data engineering experience • At least 3 years specifically supporting Azure Databricks and related Azure data services • Expertise in Apache Spark, Delta Lake, Python, SQL, and Scala • Hands-on experience designing and optimizing large-scale ETL/ELT pipelines • Experience with Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, Databricks workflows, data modeling, and big data technologies • Experience configuring and managing Databricks workspaces, clusters, compute resources, security controls, access management, and cost optimization • Experience implementing CI/CD or infrastructure as code using Git and tools such as Terraform, Databricks Asset Bundles, GitHub Actions, Azure DevOps, or comparable technologies • Experience with Agile delivery, data governance, data security, performance troubleshooting, and stakeholder communication • Ability to satisfy FDIC personnel eligibility and background-investigation requirements • U.S. Citizenship required due to federal contract requirements • Candidate must reside in the U.S., be authorized to work in the U.S., and perform all work in the U.S. • Preferred: Databricks, Azure, Unity Catalog, streaming, Generative AI, MLflow, BCDR, federal compliance, Docker, Kubernetes, REST APIs, and federal data modernization experience • Databricks certifications or comparable demonstrated experience preferred

🏖️ Benefits

• Equal opportunity employer • Reasonable accommodations for disabled veterans, individuals with disabilities, and individuals with sincerely held religious beliefs • Confidential accommodation support • Benefit offerings referenced under the Transparency in (Benefits) Coverage Act