Data Engineer – AI-Driven Data Platforms

πŸ•’ July 23

πŸ‡ΊπŸ‡Έ United States – Remote

⏰ Full Time

🟑 Mid-level

🚰 Data Engineer

Where this job comes from

Posted on Spark Eighteen's careers page β†—Spark Eighteen's careers page, not through a job board

First seen by Remote Rocketship July 23

Still open on Spark Eighteen's site. Checked 3 hours ago.

Apply Now
Logo of Spark Eighteen

Spark Eighteen

51 - 200 employees

Founded 2012

πŸ’Ό Consulting

πŸ“£ Marketing

πŸ₯ Healthcare

Consulting β€’ Marketing β€’ Healthcare

Spark Eighteen is a design-led digital product studio and engineering agency that builds web and mobile products focused on impeccable user experience. They offer product development, UI/UX design, website & app development, and digital marketing, working from concept to prototype and production for startups and businesses. Their portfolio includes SaaS and enterprise product work across healthcare and business process optimization, and they position themselves as a partner combining technology, creativity, and data to optimize digital presence.

πŸ“‹ Description

β€’ This is a remote position. β€’ We are seeking a Data Engineer with 5+ years of experience to build and scale data platforms powering AI-driven analytics on high-volume sensor, satellite, and third-party data. β€’ The ideal candidate will have expertise in designing and managing scalable batch and real-time data pipelines using Apache Airflow, Apache Spark, Kafka, Python, and SQL. β€’ Strong experience with PostgreSQL, TimescaleDB, PostGIS, cloud-based data lake architectures, and geospatial/time-series data is essential. β€’ The role involves owning data pipelines end-to-endβ€”from real-time ingestion to analyticsβ€”while ensuring data quality, performance, observability, and reliability in a cloud-native environment. β€’ Strong stakeholder management, problem-solving, and collaboration skills are key to delivering impactful data products and analytical solutions.

🎯 Requirements

β€’ 5+ years of experience in Data Engineering and production-scale data platforms β€’ Design and manage Apache Airflow pipelines for high-volume sensor, satellite, and third-party data ingestion β€’ Build and optimize Apache Spark workloads for batch processing, geospatial analytics, and large-scale aggregations β€’ Develop and maintain PostgreSQL, TimescaleDB, PostGIS, and DuckDB-based data solutions β€’ Implement Kafka-based streaming pipelines for real-time data ingestion β€’ Work with Object Storage (AWS S3 or equivalent) for scalable data lake architecture β€’ Strong proficiency in Python, SQL, Airflow, Spark, and PostgreSQL β€’ Experience with geospatial and time-series data β€’ Comfortable working in Ubuntu-based environments β€’ Collaborate with customer teams to translate business requirements into data products and analytical solutions β€’ Ensure data quality, lineage, observability, performance, and SLA compliance β€’ Troubleshoot production issues and optimize pipeline, database, and query performance β€’ Create and maintain technical documentation, data models, and run-books β€’ Strong communication, stakeholder management, and problem-solving skills

πŸ–οΈ Benefits

β€’ Comprehensive insurance coverage that gives you peace of mind, so you can focus on doing your best work β€’ Flexible work arrangements designed to support sustained productivity, personal well-being, and work-life balance β€’ Continuous learning and accelerated skill development through hands-on projects and mentorship from experienced industry leaders β€’ Global client exposure across 20+ countries, offering real-world experience with diverse markets and business environments β€’ Opportunity to work on high-impact, large-scale projects that have collectively generated over $1B in measurable business value β€’ Competitive, market-aligned compensation packages that recognize performance, expertise, and long-term contribution β€’ Monthly demo days that celebrate innovation, showcase your work, and give you a real voice in what we build β€’ Annual recognition programs and performance-driven awards in a truly meritocratic environment β€’ Referral bonuses that reward you for helping grow a strong, like-minded team β€’ A strong problem-solving culture with opportunities to tackle meaningful, real-world challenges β€’ A positive, people-first workplace that supports happiness, balance, and long-term growth

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ July 22

Accelerant

201 - 500

πŸ›‘οΈ Insurance

☁️ SaaS

🀝 B2B

Product Manager enhancing insurance industry's AI-driven Data Platform. Collaborating with teams to deliver innovative, data-driven solutions for Risk Exchange efficiency.

πŸ•’ July 20

Accenture Federal Services

10,000+ employees

πŸ’Ό Consulting

πŸŽ–οΈ Defense

πŸ“¦ Logistics

GCP Data Engineer doing robust data architecture and pipelines for federal data migration. Collaborating on critical mission objectives and developing secure data solutions.

πŸ•’ July 18

MESO SCALE DIAGNOSTICS, LLC.

201 - 500

πŸ₯ Healthcare

🏭 Manufacturing

πŸ’Ό Consulting

Data Engineer managing and organizing data for corporate goals. Responsible for developing data pipelines and collaborating with technical experts on data management.

πŸ•’ July 15

Omada Health

201 - 500

πŸ₯ Healthcare

βš•οΈ Healthcare Insurance

🧘 Wellness

Senior Software Engineer developing modern data platforms and AI-driven solutions at Omada Health. Collaborating with cross-functional teams to enhance data discovery and governance.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $179.4k - $224.3k / year

πŸ’° $192M Series E on 2022-02

⏰ Full Time

🟑 Mid-level

🟠 Senior

🚰 Data Engineer

πŸ•’ July 14

Omada Health

201 - 500

πŸ₯ Healthcare

βš•οΈ Healthcare Insurance

🧘 Wellness

Senior Software Engineer designing and maintaining data architectures at Omada Health. Collaborating on data models and pipelines to drive efficient data-driven decision making.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $179.4k - $224.3k / year

πŸ’° $192M Series E on 2022-02

⏰ Full Time

🟑 Mid-level

🟠 Senior

🚰 Data Engineer

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok