Data Engineer, Databricks

🕒 August 4

🇺🇸 United States – Remote

💵 $113k - $188k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

🦅 H1B Visa Sponsor

infoinfo

👻 Ghost score 48%

infoinfo
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Guidehouse

Guidehouse

10,000+ employees

Founded 2018

🏥 Healthcare

🎖️ Defense

📦 Logistics

💰 Grant on 2023-02

Healthcare • Defense • Logistics

Guidehouse is a global consultancy offering advisory, digital, and managed services across commercial and public sectors. It is purpose-built to support industries such as national security, financial services, healthcare, energy, and infrastructure. Guidehouse collaborates with leaders to navigate complexity and drives transformational changes that impact the future. Their expertise spans data analytics, digital technologies, risk management, and more, with a strong emphasis on sustainability and innovation.

📋 Description

• Design, build, and maintain scalable data pipelines using Databricks, PySpark, SQL, Delta Lake, and cloud-native data engineering tools • Develop and support batch and streaming data workflows, including ingestion, transformation, validation, and publishing curated data products • Write, optimize, and maintain Python, PySpark, and SQL code for data processing, orchestration, and performance tuning • Work with large-scale datasets using Databricks, Spark, Delta Lake, Unity Catalog, and cloud storage services • Troubleshoot data pipeline failures, performance issues, data quality issues, and workflow bottlenecks • Translate business and technical requirements into data engineering designs, processing scripts, and job orchestration workflows • Perform data validation, quality checks, code reviews, and issue resolution • Collaborate with solution architects, data scientists, analysts, DevOps engineers, and client stakeholders • Communicate technical concepts, delivery impacts, and data engineering considerations to technical and non-technical audiences • Document pipelines, datasets, data models, workflows, and engineering decisions • Follow data governance, security, lineage, and compliance standards within the Databricks platform • Support Guidehouse client projects involving large-scale data pipelines, data transformation, platform modernization, and advanced analytics and AI solution delivery

🎯 Requirements

• Bachelor’s degree in computer science, engineering, mathematics, statistics, or another relevant field • 3-8 years of relevant experience in data engineering, data architecture, or cloud data platform implementation • Strong experience with Python, PySpark, and SQL • Experience with Databricks, Spark, Delta Lake, Unity Catalog, or similar cloud-native data platforms • Experience developing batch or streaming data pipelines and ETL/ELT workflows • Experience with data modeling, data warehousing, data quality validation, and large-scale data processing • Ability to troubleshoot technical issues and communicate engineering recommendations clearly • Experience applying data governance, access control, lineage, and security practices within cloud data platforms • 2+ years of hands-on Databricks platform experience (nice to have) • Experience using Unity Catalog for governance, schema design, data modeling standards, access controls, lineage, and secure enterprise data asset management (nice to have) • Experience with standard medallion data architectures (nice to have) • Active Databricks Data Engineer Associate, Databricks Data Engineer Professional, or related certification (nice to have) • Experience with CI/CD tools and practices (nice to have) • Experience with Azure, AWS, or GCP (nice to have) • Experience in project-based or consulting delivery environments (nice to have) • Familiarity with streaming frameworks, orchestration tools, Terraform, or related data platform administration capabilities (nice to have)

🏖️ Benefits

• Competitive compensation • Flexible benefits package • Flexible work arrangements / virtual work flexibility within the United States • Equal Opportunity Employer protections • Reasonable accommodation support

Apply Now

Similar Jobs

🕒 July 31

Life360

201 - 500

👥 B2C

📡 Telecommunications

Senior Data Engineer II enhancing and maintaining data processing systems for Life360. Collaborating with teams to leverage data for real-time analytics and machine learning.

🕒 July 31

Zeta Global

1001 - 5000

💼 Consulting

📦 Logistics

✈️ Travel

Lead Data Engineer at Zeta Global, focusing on healthcare data applications and compliance. Involves system design, data pipelines, and collaboration with product and data teams.

🕒 July 31

Quantiphi

1001 - 5000

💼 Consulting

🏥 Healthcare

📦 Logistics

Lead architectural vision for a modern data layer at an AI-first digital engineering company. Ensure data integration and performance for complex AI applications.

🕒 July 31

Egis

10,000+ employees

🏗️ Construction

💼 Consulting

Senior Data Engineer responsible for designing and optimizing Azure-based data architectures. Supports advanced analytics and machine learning initiatives at Immersion Consulting, LLC.