Senior DevOps Engineer

Job not on LinkedIn

November 15

🏄 California – Remote

Although this job is listed in California, this company may be open to hiring remote in other states.

💵 $155k - $175k / year

⏰ Full Time

🟠 Senior

⛑ DevOps & Site Reliability Engineer (SRE)

🦅 H1B Visa Sponsor

Apply Now

Receive Emails with Similar Jobs

The Linux Foundation

WebsiteLinkedInAll Job Openings

Non-profit • Education • Enterprise

The Linux Foundation is a non-profit organization that provides a neutral, trusted platform for developers and organizations to collaborate on open technology projects and ecosystems. With a diverse array of initiatives, it supports over 900 open source projects and has trained over 3 million developers. The foundation aims to drive the future of open technology by providing tools and expertise to scale community projects across open software, hardware, standards, and data. It also actively works on security, digital trust, and sustainability, contributing significantly to open-source strategies and best practices worldwide. Additionally, The Linux Foundation offers educational resources and research initiatives to further promote open source technology and collaboration.

201 - 500 employees

Founded 2000

🤝 Non-profit

📚 Education

🏢 Enterprise

📋 Description

• Maintain and monitor production data pipelines to ensure consistent, on-time runs. • Troubleshoot and resolve operational issues across development, staging, and production environments. • Implement logging, alerting, and metrics for end-to-end observability. • Manage pipeline configurations, scheduling, and environment consistency. • Design and manage CI/CD workflows in GitHub for building, testing, and deploying pipeline components. • Enforce consistent branching, testing, and release practices across repositories. • Automate build, test, and deployment workflows for both code and data releases. • Support versioning and reproducibility for datasets and schema changes. • Ensure pipelines and supporting systems are deployable across both AWS and Azure environments. • Coordinate with CloudOps to manage cloud infrastructure for pipeline execution, following Overture’s platform-agnostic guidance. • Maintain reproducible environments and ensure secure, efficient use of compute and storage resources. • Work across Engineering Operations to schedule and optimize compute resources, ensuring cost efficiency, security, and scalability of cloud-based data systems. • Implement infrastructure and operational automation to reduce manual intervention. • Support Release Operations by integrating QA/QC validation into CI/CD processes. • Partner with ReleaseOps to validate release candidates and monitor data QA/QC jobs. • Automate post-release tasks such as metadata updates or data viewer refreshes. • Maintain operational runbooks and documentation for release reliability and repeatability.

🎯 Requirements

• 4+ years of experience in Data Engineering, DevOps, or related engineering operations roles. • Hands-on experience operating distributed pipelines built with Airflow, Spark, and Python or Scala. • Strong knowledge of GitHub workflows, CI/CD automation, and multi-environment deployments. • Familiarity with data platforms that use SparkSQL, Iceberg, Parquet, and object storage (S3 or Azure Blob). • Solid understanding of monitoring, alerting, and release automation.

🏖️ Benefits

• Fantastic health care • Unlimited PTO • 100% 401k match • profit-sharing • exceptional healthcare plans