Senior Data Engineer

Job not on LinkedIn

November 20

Apply Now

Receive Emails with Similar Jobs

Agility Robotics

WebsiteLinkedInAll Job Openings

Hardware • Artificial Intelligence • Enterprise

Agility Robotics is a leading manufacturer of mobile manipulation robots, known for their humanoid robot Digit. The company focuses on deploying its robots in commercial settings, such as material handling workflows, to enhance productivity across various industries including third-party logistics, manufacturing, and retail & eCommerce. With their innovative cloud automation solution, Agility Arc, these robots provide game-changing automation solutions. Agility Robotics aims to revolutionize labor by integrating humanoid robots in settings where meaningful work and economic value are crucial.

201 - 500 employees

Founded 2017

🔧 Hardware

🤖 Artificial Intelligence

🏢 Enterprise

📋 Description

• Collaborate with robot software and hardware teams to define, collect, and curate data needed for analytics and debugging. • Develop and maintain ETL pipelines that transform raw robot logs and telemetry into structured datasets using Spark, Airflow (or equivalent orchestration tools), and AWS data services. • Contribute to on-robot data production workflows to ensure high-fidelity, well-structured data capture. • Design derived datasets and transformations across Avro, Parquet, and other sensor data formats to power fleet operations, reliability analysis, and business metrics. • Implement data quality checks, schema evolution, and metadata management practices using our internal Data Registry and cataloging systems. • Work closely with the ingestion and storage services that move robot data into the cloud (S3-based data lake). • Collaborate with internal consumers — reliability, analytics, and ML teams — to design efficient data models for their workflows. • Occasionally contribute to shared libraries or APIs in Python, Java, or C++ to support data capture and consumption.

🎯 Requirements

• 5+ years of experience as a Data Engineer or similar role building and maintaining production data pipelines. • Strong proficiency in Apache Spark or equivalent distributed data processing frameworks. • Experience with Airflow, Dagster, Prefect, or other data orchestration systems. • Proficiency with data formats such as Avro, Parquet, and structured/numeric datasets. • Solid understanding of data modeling, schema evolution, and data quality best practices. • Good intuitions of how to model datasets logically and partition them physically for optimal query performance. • Strong programming skills in Python, Java and/or Scala. • Experience with AWS data stack (S3, Glue, Athena, EMR, etc.) or similar cloud infrastructure. • Experience working with vision data pipelines (e.g. Images, video, depth) and building derived datasets from them. • Comfort working cross-functionally with software, hardware, and analytics teams in a fast-paced environment.

🏖️ Benefits

• 401(k) Plan: Includes a 6% company match. • Equity: Company stock options. • Insurance Coverage: 100% company-paid medical, dental, vision, and short/long-term disability insurance for employees. • Benefit Start Date: Eligible for benefits on your first day of employment. • Well-Being Support: Employee Assistance Program (EAP). • Time Off: Flexible, unlimited PTO and 10 company holidays, including a winter shutdown. • On-Site Perks: Catered lunches four times a week and a variety of healthy snacks and refreshments at our Salem and Pittsburgh locations. • Parental Leave: Generous paid parental leave programs. • Work Environment: A culture that supports flexible work arrangements. • Growth Opportunities: Professional development and tuition reimbursement programs. • Relocation Assistance: Provided for eligible roles.