Senior Databricks Engineer

Vaga não está no LinkedIn

🕒 Outubro 13

🏛️ District of Columbia, Washington – Remoto

🏛️ District of Columbia – Remote ☕ Washington – Remote

⏰ Tempo Integral

🟠 Sênior

👷🏻‍♀️ Engenheiro

👻 Score fantasma 10%

O que significa: a chance de ninguém estar realmente contratando para esta vaga.Como ler: 60% ou mais significa que achamos que é uma vaga fantasma. Pontuações mais baixas preocupam menos.Como pontuamos: tempo em aberto, republicações, vagas abertas vs tamanho do time, rapidez para fechar vagas, e se o salário está divulgado.Observação: é uma estimativa de dados públicos, não um julgamento da empresa. Vagas reais podem ter pontuação alta, então use como uma dica, não como um fato.

Candidatar-se

Encontrar Vagas Remotas Similares

Koniag Government Services

SiteLinkedInTodas as Vagas

1001 - 5000 funcionários

Fundada em 1975

🏛️ Governo

🎖️ Defesa

💼 Consultoria

Government • Defense • Consulting

A Koniag Government Services é uma Corporação Nativa do Alaska (ANC) que fornece expertise técnica, profissional e operacional para o setor público dos EUA. A KGS apoia os clientes de Defesa & Inteligência, Civil Federal e Saúde com soluções corporativas, serviços profissionais e gestão de operações, enfatizando resultados focados na missão, velocidade na contratação (prêmios diretos ANC) e parcerias estratégicas/tecnológicas. A empresa se posiciona como um parceiro de missão entregando pessoas, tecnologia e gestão de programas para clientes governamentais.

Descrição

• Design, develop, and deploy scalable data infrastructure • Drive key data engineering initiatives using the Databricks platform and modern data warehousing • Build data pipelines supporting the Department of State’s “4Ps” data lake • Work with project managers, team members, and business owners to gather requirements, communicate progress, and ensure data meets customer needs • Architect and implement scalable, highly available data pipelines using Databricks and the Medallion Architecture • Establish data quality standards and implement monitoring dashboards • Write production-ready PySpark and SQL code for complex ETL/ELT processes • Develop DLT and structured streaming pipelines • Design and build data ingestion pipelines using RESTful API integrations • Implement infrastructure and pipelines as code • Automate deployments across Development, Staging, and Production using Databricks Asset Bundles and Azure DevOps • Develop, package, and maintain custom Python libraries and modules • Apply data warehousing concepts, including dimensional modeling and slowly changing dimensions • Monitor, troubleshoot, and optimize Databricks clusters and Spark jobs • Share data securely with external BI tools such as PowerBI and SAP BusinessObjects • Develop dashboards and capabilities natively within the Databricks environment • Serve as a technical SME, conduct code reviews, establish best practices, and mentor staff members

🎯 Requisitos

• Active SECRET clearance • Knowledge of Object Oriented Programming (OOP) concepts • Proficiency in one or more programming or scripting languages: Java, C#, Python, JavaScript, or PowerShell • 8+ years of dedicated Data Engineering experience • At least 3+ years functioning in a senior capacity focused on the Databricks ecosystem • Expert-level proficiency in PySpark and complex SQL • Proven ability to create, package, and manage custom Python libraries, including building Wheel files • Deep understanding of HTTP REST methods such as GET, POST, and PUT • Hands-on experience extracting, paginating, and processing data from external API sources • Deep theoretical and practical understanding of modern Data Warehousing concepts • Hands-on experience building out the Medallion Architecture • Proven experience automating Databricks deployments • Hands-on experience configuring and deploying Databricks Asset Bundles (DABs) using Azure DevOps, including creating YAML pipelines, managing service principals, and handling multi-workspace deployments • Strong familiarity with Azure Data Lake Storage Gen2 and Azure Key Vault • Proficiency with Git-based version control workflows • Concise and comprehensive written and oral communication skills for technical understanding and customer usage support • Desired: Experience with Tableau, PowerBI, Jupyter Notebooks, d3js, Elasticsearch, SOLR, and Lucene • Desired: Experience working with HR application (PeopleSoft) data for reporting purposes • Desired: 3+ years of .NET, Java, or similar OOP experience • Desired: Experience writing Oracle PL/SQL queries, packages, and procedures • Desired: Experience architecting Data Vault 2.0 solutions

🏖️ Benefícios

• Medical, dental, and vision insurance • 401(k) retirement plan • Paid time off • Paid parental leave • Life and disability insurance • Flexible spending accounts • Commuter benefits • Tuition reimbursement

📊 Verifique sua pontuação de currículo para esta vaga

Melhore suas chances de conseguir uma entrevista verificando sua pontuação de currículo antes de se candidatar.

Enviar Currículo