Data Engineer, Databricks

Job not on LinkedIn

🔥 0 minutes ago

🇺🇸 United States – Remote

💵 $112k - $179k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Peraton

WebsiteLinkedInAll Job Openings

10,000+ employees

💼 Consulting

🏥 Healthcare

📦 Logistics

Consulting • Healthcare • Logistics

Peraton is a mission-focused enterprise that supports national security initiatives through advanced IT and cyber services. They provide capabilities in areas such as cyber defense, cloud operations, engineering, and intelligence. With a commitment to solving complex challenges, Peraton integrates data-driven technologies to ensure mission success for their military and government clients.

📋 Description

• Build out and configure a dedicated Government workspace within the existing Databricks environment • Design and implement data ingestion pipelines from core agency business systems, including financial, HR, CRM, and ITSM systems • Leverage native/built-in connectors where source systems support them and design custom integration approaches for legacy systems • Normalize and prepare ingested data within Databricks for downstream visualization/reporting tools • Implement Databricks Unity Catalog for centralized data governance, metadata management, active auditing, and end-to-end lineage tracking • Review current configuration, assess security controls for CUI/PII/PHI/financial data, and implement improvements • Develop comprehensive as-built documentation, including physical/logical architecture diagrams, automated data dictionaries, and SOPs • Document data sources, integration methods, and data lake architecture decisions to support sustainment

🎯 Requirements

• 5 years work experience with BS/BA; 3 years with MS/MA • US Citizenship • Active DoD Secret clearance • 2 years working on the Databricks platform • Strong proficiency in PySpark, Spark SQL, and Python for large-scale data processing and pipeline development • Hands-on experience with Unity Catalog administration, including metastore management, access policies, and data lineage • Experience with pipeline orchestration tools, including Airflow and Databricks Workflows • Experience with Delta Lake, schema evolution, time travel, and optimization techniques • Experience integrating heterogeneous enterprise systems, including legacy/custom integrations • Familiarity with cloud platforms, including Azure/AWS, and infrastructure-as-code practices • Understanding of data governance principles, compliance frameworks, and CUI/PII handling practices • Familiarity with financial, HR, CRM, or ITSM data structures • Git/CI-CD pipeline experience • DoD 8570 certification • Databricks Certified Data Engineer Associate or Professional certification preferred

🏖️ Benefits

• Potential eligibility for overtime • Potential eligibility for shift differential • Potential eligibility for a discretionary bonus • Equal opportunity employment, including disability and protected veterans