Data Engineer – DataOps, Infrastructure Focus

🕒 May 6

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Guidewire Software

Guidewire Software

1001 - 5000 employees

Founded 2001

💰 $750k Series C on 2008-03

Software • Insurance • Cloud Computing

Guidewire Software is a leading provider of software solutions for the property and casualty (P&C) insurance industry. The company offers a comprehensive platform that includes core applications such as PolicyCenter, ClaimCenter, and BillingCenter, as well as advanced analytics and a robust cloud platform. Guidewire focuses on delivering digital transformations, improving operational efficiencies, and enhancing customer service for insurers globally. Through collaborations and partnerships, Guidewire supports a wide range of insurance products and services, including usage-based and embedded insurance. With its commitment to innovation and customer success, Guidewire continues to empower insurers to meet the evolving demands of the industry.

📋 Description

• Architect, automate, and maintain production-grade data infrastructure on AWS (e.g., S3, EMR, Glue, Lambda, Redshift) using Terraform or CDK, with a focus on high availability, security, and consistent environments across the SDLC. • Integrate Claude Code and other LLM-based agents into the engineering workflow to accelerate infrastructure provisioning, refactoring, and generation of technical documentation, embedding AI into daily development practices. • Design, build, and optimize CI/CD pipelines that test, deploy, and monitor dbt models and AWS Glue/Spark jobs, ensuring reliable, repeatable delivery of governed data assets. • Implement agentic operations for DataOps—configuring AI agents to triage and perform root-cause analysis of pipeline failures, surface cost-optimization signals, and proactively detect schema drift or data quality regressions. • Engineer scalable, well-governed data pipelines and tables using Apache Iceberg, Airflow (MWAA), and Redshift, emphasizing simplicity, reusability, and clear ownership of data products. • Operationalize security and compliance best practices in a regulated insurance environment, including IAM automation, encryption, audit-ready logging, and alignment with enterprise RBAC/MFA standards. • Partner with Product Strategy, PDO, and data science teams to ensure data platforms and features can support AI-heavy products like the Agentic AI Platform, Claim Summary, and Underwriting Assistant at scale.

🎯 Requirements

• 5+ years of experience in Data Engineering, Data Operations, or Platform Engineering building and operating cloud data infrastructure. • Deep proficiency with AWS (e.g., S3, EMR, Glue, Lambda, Redshift) and infrastructure-as-code (Terraform strongly preferred; CDK a plus), including designing secure, resilient architectures. • Strong experience with dbt in production (modeling, testing, documentation, deployment) and modern table formats such as Apache Iceberg for large-scale analytics. • Advanced SQL skills (performance tuning, complex joins and window functions) and solid Python experience for automation, orchestration, and data engineering tasks. • Hands-on experience with Apache Spark for large-scale batch or streaming workloads, ideally on AWS EMR or Glue. • Proven track record of building or maintaining CI/CD pipelines (Git-based workflows, automated testing, deployment, and monitoring) for data and analytics workloads. • Strong systems thinking and data modeling skills (e.g., Kimball, Data Vault) and familiarity with integrating RDBMS data via CDC patterns. • Clear, collaborative communication style with the ability to work across product, security, and business stakeholders in a distributed environment.

🏖️ Benefits

• Flexible work environment • Health and Wellness benefits • Paid time off programs including volunteer time off • Market-competitive pay and incentive programs • Continual development and internal career growth opportunities

Apply Now

Similar Jobs

🕒 May 6

Kroll

5001 - 10000

💸 Finance

🔐 Security

📋 Compliance

Senior Data Engineer at Kroll, designing and implementing data pipelines for analytics and automation. Collaborating with teams to scale data infrastructure that supports AI and business insights.

Azure

Cloud

Docker

ETL

Kubernetes

Pandas

Python

SQL

Tableau

🕒 May 6

Pavion

1001 - 5000

🔐 Security

🏢 Enterprise

🤝 B2B

Data Engineer supporting data strategy and building data infrastructure for Pavion. Responsible for data pipelines, quality, and collaboration across business units in a fast-paced environment.

🇺🇸 United States – Remote

💵 $130k - $160k / year

💰 Private equity on 2016-12

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

Azure

Cloud

ERP

ETL

RDBMS

SQL

Tableau

🕒 May 6

Paramount

10,000+ employees

📱 Media

👥 B2C

Senior Lead Data Engineer building and scaling data foundations for next-generation personalization systems at Paramount. Collaborating with teams to deliver reliable, ML-ready data at global scale.

Airflow

Amazon Redshift

AWS

Azure

Google Cloud Platform

Kafka

PySpark

Python

Scala

Spark

SQL

Terraform

🕒 May 6

RecruityTalent

1 - 10

🎯 Recruiter

🤝 B2B

Data Engineering Lead responsible for coding standards and technical leadership in Spark applications. Collaborating with cross-functional teams to ensure high-quality software solutions for various clients.

Apache

Azure

Cloud

Docker

Kubernetes

Microservices

Pandas

Python

Redis

Spark

🕒 May 5

SandboxAQ

51 - 200

🤖 Artificial Intelligence

🔒 Cybersecurity

💊 Pharmaceuticals

Data Engineer building and optimizing data pipelines for quantum navigation solutions at SandboxAQ. Collaborating with a diverse team to enhance data infrastructure and support advanced models.

AWS

Cloud

Docker

Python

SQL