Data Engineer, Databricks

🔥 13 hours ago

🇺🇸 United States – Remote

💵 $112k - $179k / year

⏰ Full Time

🟠 Senior

🔴 Lead

🚰 Data Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Peraton

WebsiteLinkedInAll Job Openings

10,000+ employees

💼 Consulting

🏥 Healthcare

📦 Logistics

Consulting • Healthcare • Logistics

Peraton is a mission-focused enterprise that supports national security initiatives through advanced IT and cyber services. They provide capabilities in areas such as cyber defense, cloud operations, engineering, and intelligence. With a commitment to solving complex challenges, Peraton integrates data-driven technologies to ensure mission success for their military and government clients.

📋 Description

• Build out and configure a dedicated Government workspace within the existing Databricks environment • Design and implement data ingestion pipelines from core agency business systems, including financial, HR, CRM, and ITSM systems • Leverage native/built-in connectors where source systems support them and design custom integration approaches for legacy systems • Normalize and prepare ingested data within Databricks for downstream visualization/reporting tools • Implement Databricks Unity Catalog for centralized data governance, metadata management, active auditing, and end-to-end lineage tracking • Review current configuration, assess security controls for CUI/PII/PHI/financial data, and implement improvements • Develop comprehensive as-built documentation, including physical/logical architecture diagrams, automated data dictionaries, and SOPs • Document data sources, integration methods, and data lake architecture decisions to support sustainment beyond the pilot

🎯 Requirements

• Minimum 8 years of experience with BS/BA, minimum 6 years with MS/MA, or minimum 3 years with PhD • US Citizenship • Active DoD Secret clearance • 2 years working on the Databricks platform • Strong proficiency in PySpark, Spark SQL, and Python for large-scale data processing and pipeline development • Hands-on experience with Unity Catalog administration, including metastore management, access policies, and data lineage • Experience with pipeline orchestration tools (Airflow, Databricks Workflows) • Experience with Delta Lake, schema evolution, time travel, and optimization techniques • Experience integrating heterogeneous enterprise systems, including legacy/custom integrations • Familiarity with cloud platforms (Azure/AWS) and infrastructure-as-code practices • Understanding of data governance principles, compliance frameworks, and CUI/PII handling practices • Familiarity with financial, HR, CRM, or ITSM data structures • Git/CI-CD pipeline experience • DoD 8570 certification • Preferred: Databricks Certified Data Engineer Associate or Professional certification