Principal Data Engineer

Job not on LinkedIn

🔥 0 minutes ago

🇺🇸 United States – Remote

⏰ Full Time

🔴 Lead

🚰 Data Engineer

👻 Ghost score 10%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Octus

WebsiteLinkedInAll Job Openings

501 - 1000 employees

Founded 2013

💼 Consulting

⚖️ Legal

📚 Education

Consulting • Legal • Education

Octus is a platform that connects professionals, enabling them to explore job opportunities, enhance their skills through various courses, and engage with a broad community. It offers resources for career development and networking, along with tools for job postings and recruitment. The platform emphasizes continuous learning, professional growth, and collaboration within a professional network.

📋 Description

• Lead the overarching technical strategy for the data platform, aligning data infrastructure with long-term business goals • Lead the design and development of scalable, efficient, and reliable data ingestion and transformation pipelines across APIs, web data, internal feeds, and other sources • Mentor senior engineers within the data platform team and guide architecture, design, and implementation decisions • Architect and manage data pipelines and orchestration workflows using AWS MWAA/Airflow, Lambda, ECS, and SQS • Implement and maintain infrastructure as code using Terraform • Partner with data analysts, scientists, and backend engineers to ensure data consistency, discoverability, and reliability • Apply best practices in data modeling, schema design, and ETL/ELT processes for high-volume structured and semi-structured data • Ensure data quality and lineage through automated testing, monitoring, and alerting • Promote continuous improvement through code reviews, observability practices, and team-wide knowledge sharing • Collaborate with technology leadership to align data platform development with business strategy and product goals • Stay current with trends in data engineering, cloud architecture, AI/ML integration, and automation

🎯 Requirements

• Strong foundation in software engineering principles, including SOLID design, modularity, and scalability • Expert proficiency in Python for data pipeline and automation development • Advanced SQL skills and experience optimizing complex queries and data models • Proven experience designing and maintaining cloud-native data pipelines on AWS, including MWAA/Airflow, Lambda, ECS, SQS, Glue, S3, and Redshift • Experience with data warehousing or lakehouse technologies such as Redshift, Snowflake, or Databricks • Experience implementing and managing Terraform or similar IaC frameworks • Strong understanding of data ingestion, transformation, and orchestration tools and patterns, including those used in AI/ML pipelines • Familiarity with CI/CD pipelines, automated testing, and modern DevOps practices • 8+ years of experience in data engineering or backend development, focused on scalable data solutions • Extensive experience in a technical leadership capacity, including mentoring and leading complex data infrastructure projects end-to-end • Familiarity with containerization using Docker and workflow orchestration best practices • Excellent communication, collaboration, and problem-solving skills

🏖️ Benefits

• Competitive health benefits • Matched 401k and pension plans • PTO • Generous parental leave • Gym subsidies • Educational reimbursements for career development • Recognition programs