Senior Databricks Engineer

Job not on LinkedIn

🔥 1 minute ago

🏛️ District of Columbia, Washington – Remote

🏛️ District of Columbia – Remote ☕ Washington – Remote

⏰ Full Time

🟠 Senior

👷🏻‍♀️ Engineer

👻 Ghost score 10%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Koniag Government Services

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 1975

🏛️ Government

🎖️ Defense

💼 Consulting

Government • Defense • Consulting

Koniag Government Services is an Alaska Native Corporation (ANC) that provides technical, professional, and operational expertise to the U. S. public sector. KGS supports Defense & Intelligence, Federal Civilian, and Health customers with enterprise solutions, professional services, and operations management, and emphasizes mission-focused outcomes, contracting speed (ANC direct awards), and strategic/technology partnerships. The company positions itself as a mission partner delivering people, technology, and program management to government customers.

📋 Description

• Design, develop, and deploy scalable data infrastructure • Drive key data engineering initiatives supporting the Department of State’s “4Ps” data lake • Collaborate with project managers, team members, and business owners to gather requirements and communicate progress • Architect and implement scalable, highly available Databricks data pipelines using the Medallion Architecture • Establish data quality standards and monitoring dashboards • Write production-ready PySpark and SQL code for complex ETL/ELT processes • Develop DLT and structured streaming pipelines • Build data ingestion pipelines using RESTful API integrations • Implement infrastructure and pipelines as code • Automate deployments across Development, Staging, and Production using DABs and Azure DevOps • Develop, package, and maintain reusable custom Python libraries and modules • Apply data warehousing concepts including dimensional modeling and slowly changing dimensions • Monitor, troubleshoot, and optimize Databricks clusters and Spark jobs • Share data securely with external BI tools such as PowerBI and SAP BusinessObjects • Develop dashboards and capabilities natively within Databricks • Serve as a technical SME, conduct code reviews, establish best practices, and mentor staff

🎯 Requirements

• Active SECRET clearance • Knowledge of Object Oriented Programming (OOP) concepts • Proficiency in one or more programming or scripting languages: Java, C#, Python, JavaScript, or PowerShell • 8+ years of dedicated Data Engineering experience • At least 3+ years functioning in a senior capacity focused on the Databricks ecosystem • Expert-level proficiency in PySpark and complex SQL • Proven ability to create, package, and manage custom Python libraries, including building Wheel files • Deep understanding of HTTP REST methods, with hands-on experience extracting, paginating, and processing data from external API sources • Deep theoretical and practical understanding of modern Data Warehousing concepts • Hands-on experience building the Medallion Architecture • Proven experience automating Databricks deployments • Hands-on experience configuring and deploying Databricks Asset Bundles (DABs) using Azure DevOps, including creating YAML pipelines, managing service principals, and handling multi-workspace deployments • Strong familiarity with Azure Data Lake Storage Gen2 and Azure Key Vault • Proficiency with Git-based version control workflows • Concise and comprehensive written and oral communication skills for technical understanding and customer usage support

🏖️ Benefits

• Medical, dental, and vision insurance • 401(k) retirement plan • Paid time off • Paid parental leave • Life and disability insurance • Flexible spending accounts • Commuter benefits • Tuition reimbursement

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume