Senior Data Engineer

Job not on LinkedIn

🔥 8 minutes ago

🇺🇸 United States – Remote

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 13%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Seneca Holdings

WebsiteLinkedInAll Job Openings

501 - 1000 employees

💼 Consulting

🏥 Healthcare

📦 Logistics

Consulting • Healthcare • Logistics

Seneca Holdings is the investment arm of the Seneca Nation, dedicated to building a portfolio of profitable businesses that promote long-term income and self-sufficiency for the Nation. The organization focuses on diversifying revenue streams through a variety of sectors, including federal government contracting, environmental solutions, and health-related services. By investing in sustainable opportunities, Seneca Holdings aims to support the economic growth of the Seneca community while honoring its mission of serving future generations.

📋 Description

• Design, build, and maintain scalable data pipelines within a Databricks E2 environment hosted on AWS • Analyze and collect data from relational databases, APIs, external data providers, and real-time streaming sources • Design and implement pipelines to cleanse, transform, and aggregate data for reporting and analytics • Build and maintain Databricks medallion architecture using Bronze, Silver, and Gold layers • Develop source-to-target mapping documentation and conduct unit testing • Write advanced SQL aggregations and analyze data for anomalies, quality issues, and inconsistencies • Implement real-time and near-real-time ingestion using AWS DMS and other AWS-native services • Develop data-processing logic using Python and/or R with Spark, PySpark, and Pandas • Manage source code, versioning, and deployments using GitLab and CI/CD pipelines • Collaborate with cross-functional teams in an Agile project environment • Ensure alignment with FISMA High and multi-tenant security, governance, and compliance requirements • Leverage AI automation tools for pipeline development, testing, validation, and delivery

🎯 Requirements

• Proven, hands-on experience as a Data Engineer or Databricks Developer building production-grade data pipelines • Strong working knowledge of Databricks on AWS, including E2 architecture, cluster configuration, job orchestration, and workspace management • Hands-on experience with Apache Spark, PySpark, and Pandas for large-scale, distributed data processing • Solid programming skills in Python; working knowledge of R is a plus • Experience with Databricks Auto Loader for scalable, incremental file ingestion • Practical experience with AWS Database Migration Service (DMS) for change data capture and real-time data replication • Strong experience with Delta Lake and Delta tables, including schema evolution, time travel, OPTIMIZE, Z-ORDER, and VACUUM • Experience with Amazon RDS and other relational database sources used in data extraction and integration workflows • Advanced SQL skills, including complex joins, window functions, aggregations, and performance tuning • Solid understanding of medallion architecture and modern data lakehouse design principles • Experience with GitLab and CI/CD pipelines for automated testing, build, and deployment of data engineering code • Experience working in Agile/Scrum project environments

🏖️ Benefits

• Competitive pay • Medical, dental, vision, life, and disability benefits • Voluntary critical illness, hospital, and accident benefits • Health savings and flexible spending accounts • Retirement 401K plan • Paid leave programs • Flexible work-life balance • Professional development opportunities • Performance and recognition programs • Collaborative work environment • Financial and non-financial benefits for Seneca Nation members