Senior Data Engineer – GCP, Python, Iceberg, Delta Lake, Kafka, Snowflake, Databricks

Job not on LinkedIn

🔥 0 minutes ago

🇺🇸 United States – Remote

💵 $120k - $180k / year

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Railroad19

WebsiteLinkedInAll Job Openings

51 - 200 employees

☁️ SaaS

🏢 Enterprise

SaaS • Enterprise • Software Development

Railroad19 is a specialized software development company headquartered in Saratoga Springs, New York. They focus on developing customized software solutions and cloud platforms for various industries, including media, finance, energy markets, and more. With a team of skilled developers and architects, Railroad19 offers enterprise-level application development and seamless integration with existing systems for Fortune 500 companies. The company prides itself on having a highly selective hiring process to ensure top talent and nearly perfect staff retention. Their technological expertise spans a wide range of programming languages and frameworks, emphasizing mission-critical solutions tailored to client's needs.

📋 Description

• Design and implement the UniForm write layer with Delta and Iceberg dual metadata • Build GCS to BigQuery ingestion pipelines for structured operational datasets • Develop and implement solutions in Python and Spark • Implement Kafka-based CDC patterns for real-time and near-real-time ingestion • Develop data lineage, dependency tracking, and modular adapter code • Configure Snowflake Horizon external tables for zero-copy reads • Write data hub tables once using Delta Lake with Iceberg UniForm enabled for consumption by target platforms without conversion • Implement and certify Delta Sharing endpoints for Databricks consumers • Build governed access layer components including RBAC, connector registry entries, and tenant-scoped authorization • Align semantic layer models with LookML and KPI catalog definitions • Collaborate with cross-functional teams to deliver end-to-end features • Troubleshoot issues across the full stack and contribute to code quality • Design reusable data-sharing adapters connecting BigQuery-backed data products to Snowflake and Databricks

🎯 Requirements

• 6+ years of proven enterprise-level experience in Python & Spark • Advanced experience in GCP BigQuery • Strong working knowledge of Apache Iceberg, Delta Lake, and Iceberg UniForm • Experience with Delta Sharing and Kafka / CDC pipelines • Specific work experience in Snowflake Horizon Catalog and Databricks Unity Catalog • Solid experience with data lake architecture and ingestion pipeline design • Excellent communication skills and ability to work cohesively with multiple teams • Prior delivery in enterprise SaaS, media, or advertising technology (nice to have) • Active daily use of AI-assisted development tools; Claude Code preferred (nice to have)

🏖️ Benefits

• Medical insurance • Dental insurance • Vision insurance • Pet insurance • Paid Time Off • 401(k) • Competitive compensation • 100% remote work • Full-time employment