Data Engineer, Databricks

Job not on LinkedIn

🔥 0 minutes ago

🦀 Maryland – Remote

🦀 Maryland – Remote

⏰ Full Time

🟠 Senior

🔴 Lead

🚰 Data Engineer

👻 Ghost score 25%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Parra Consulting Group, Inc.

WebsiteLinkedInAll Job Openings

11 - 50 employees

🎖️ Defense

📦 Logistics

💼 Consulting

Defense • Logistics • Consulting

Parra Consulting Group, Inc. is a Service-Disabled Veteran-Owned Small Business (SDVOSB) and HUBZone Certified company that provides Subject Matter Expertise to the Warfighter and Intelligence Community. With over 15 years of experience, the company focuses on bridging program strategy and mission success through technology-driven solutions. PCG emphasizes its core values of agility, collaboration, commitment, and integrity. The company offers a broad range of services including Emerging Technologies Support, Cyberspace Operations, Engineering and Intelligence Support, and Technical Advisory Services. Parra Consulting is dedicated to enhancing customer capabilities and preparing them for future challenges.

📋 Description

• Design, build, and maintain robust, end-to-end data pipelines for an enterprise Lakehouse on Databricks and AWS • Develop and manage ETL processes with comprehensive logging and error handling to troubleshoot and resolve issues • Design data models within a Bronze, Silver, and Gold medallion architecture, selecting dimensional or relational approaches as appropriate • Analyze and decompose complex legacy SQL, rebuild pipelines and models, and compare results to validate accuracy and performance • Optimize pipeline performance and scalability using techniques such as partitioning, bucketing, and caching • Use AI-assisted coding tools to accelerate pipeline analysis, data engineering, and data modeling tasks • Help ensure data security and compliance • Collaborate with cross-functional teams to deliver analytics-ready data

🎯 Requirements

• Bachelor’s degree in Computer Science, Computer Engineering, Engineering, Math, Physics, or Information Systems and Technology • 8+ years of experience designing, developing, deploying, and managing ETL processes and data pipelines • Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements • U.S. citizenship required to support this federal contract • 3+ years of experience building, debugging, and optimizing data pipelines using Databricks notebooks, clusters, and job orchestration tools, including Delta Lake and Unity Catalog • 3+ years of experience writing Python and PySpark code for ETL scripts and custom transformations • Experience using AI-assisted coding tools, such as Claude Code or Cursor, to support data engineering and data modeling tasks • Experience with data modeling, including selecting dimensional or relational models, within a Bronze, Silver, and Gold medallion architecture • Experience using AWS services, including AWS Glue, Amazon S3, and Amazon RDS • Knowledge of ETL performance optimization techniques, such as partitioning, bucketing, and caching, and experience troubleshooting query performance • Ability to analyze and decompose complex legacy SQL, rebuild data pipelines or models, and compare results to validate accuracy and performance