Lead Data Engineer

🕒 June 10

🇺🇸 United States – Remote

💵 $143.4k - $168.7k / year

⏰ Full Time

🟠 Senior

🚰 Data Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Egen

WebsiteLinkedInAll Job Openings

501 - 1000 employees

Founded 2000

💼 Consulting

📦 Logistics

📣 Marketing

Consulting • Logistics • Marketing

Egen is a company that specializes in engineering innovative solutions using platforms, data, and generative AI. They focus on harnessing the potential of data to empower organizations and individuals, providing services across various sectors including communications, healthcare, and public sector solutions. Their customizable platforms address critical challenges in urban management, customer engagement, clinical care, and operational excellence, aiming to drive impactful outcomes for clients.

📋 Description

• Architect and optimize large-scale data platforms on Google Cloud, with BigQuery as the analytical backbone • Design and build unified batch and streaming pipelines that handle high-volume, mission-critical workloads • Lead infrastructure-as-code practices, ensuring environments are repeatable, secure, and version-controlled • Implement open table formats to enable cross-cloud and cross-engine data interoperability • Establish automated data quality, metadata, and lineage practices across the data estate • Partner with data scientists, analysts, and product teams to translate business needs into reliable data products • Mentor engineers, review designs, and raise the bar on engineering standards

🎯 Requirements

• 7+ years in data engineering, with at least 2 years in a lead or senior individual contributor capacity on Google Cloud-based platforms • **BigQuery (Advanced):** Deep knowledge of BigQuery architecture, including partitioning, clustering, slot management, storage optimization, and query execution tuning • **Streaming & Batch Pipelines:** Strong hands-on experience building unified pipelines using **Dataflow** (Apache Beam), **Dataproc**, and **Pub/Sub** • **Infrastructure as Code:** Production experience developing and managing cloud infrastructure with **Terraform** • **Open Table Formats:** Working knowledge of **Apache Iceberg**, including its role in enabling cloud and engine interoperability (e.g., across BigQuery, Spark, Snowflake) • **Data Governance:** Experience with **Dataplex** and **Data Catalog** for automated data quality checks, metadata tagging, and column-level lineage from source to destination

🏖️ Benefits

• Comprehensive Health Insurance • Paid Leave (Vacation/PTO) • Paid Holidays • Sick Leave • Parental Leave • Bereavement Leave • 401 (k) Employer Match • Employee Referral Bonuses