Software Engineer, Big Data

πŸ•’ November 3

Where this job comes from

Posted on ZipRecruiter's careers page β†—ZipRecruiter's careers page, not through a job board

First seen by Remote Rocketship November 3

Still open on ZipRecruiter's site. Checked 1 hour ago.

Apply Now
Logo of ZipRecruiter

ZipRecruiter

1001 - 5000 employees

Founded 2010

🎯 Recruiter

πŸ‘₯ HR Tech

🀝 B2B

πŸ’° $550M Post-IPO Debt on 2022-01

Recruitment β€’ HR Tech β€’ B2B

ZipRecruiter is an online employment marketplace that connects job seekers with employers. It offers a platform where candidates can create profiles and search for jobs, while employers can create accounts to list job openings. The platform sends instant job alerts to potential candidates using powerful matching technology, ensuring convenience for job seekers and efficient recruitment for businesses. ZipRecruiter's services are utilized by small & medium businesses, enterprise businesses, and individual job seekers alike, aiming to streamline the job search and recruitment process.

πŸ“‹ Description

β€’ Design, build, deploy, and maintain data pipelines and systems that make web events available in the datalake and via event streams for downstream applications β€’ Process large, evolving datasets using batch and streaming techniques while balancing speed, efficiency, and reliability β€’ Design, build, deploy, and maintain MLOps frameworks and systems that accelerate ML development across teams and products β€’ Improve the velocity, quality, observability, and reliability of ML development and ML-powered products β€’ Design, build, deploy, and maintain data documentation frameworks and tooling β€’ Design, build, deploy, and maintain Sift, an agentic data exploration and analysis tool β€’ Build scalable, reliable, and efficient infrastructure, tools, and processes that enable engineering teams to deliver products and services β€’ Build and maintain tools for data processing, dataset ingestion and discoverability, data pipeline orchestration, data documentation, data analysis, ML model pipelines, and experiments β€’ Help developers leverage AI through an agentic AI data exploration and analysis tool and an LLM Gateway

🎯 Requirements

β€’ 2+ years of professional software development experience, including building and operating data pipelines that feed into a customer facing product β€’ Hands-on Apache Spark experience: writing, tuning and debugging batch and/or streaming jobs at scale β€’ Experience deploying and operating containerized services and batch jobs β€’ Solid computer science fundamentals: data structures, algorithms, distributed systems, and testing β€’ Professional software development experience, including building and operating data pipelines and infrastructure that feed into a customer facing product β€’ Preferred: 4+ years of professional software development experience with a focus on data-intensive systems β€’ Preferred: Working knowledge of AWS (S3, IAM, EC2, MSK or equivalents) and instrumenting jobs with metrics, logs and alerts β€’ Preferred: Experience with a data lake stack: parquet on object storage, a data catalog such as AWS Glue, and an open table format such as Apache Iceberg or Delta Lake β€’ Preferred: Streaming experience with Kafka producers and consumers, Apache Flink, and/or Spark Structured Streaming β€’ Preferred: Experience with Apache Airflow, including authoring DAGs, backfills, dependency management and on-call for scheduled pipelines β€’ Preferred: Experience with open table format internals: schema evolution, partitioning, and compaction β€’ Preferred: Experience deploying services on Kubernetes with Docker β€’ Preferred: Experience building and maintaining a data platform powering a user-facing product, including streaming and batch data ingestion, ETL pipelines, data permissions management, and data discovery β€’ BS/MS/PhD in Computer Science, Mathematics, Physics or a related field, or equivalent practical experience (preferred) β€’ Must be able to work in the United States, as indicated by the US base salary range and US-based positions language

πŸ–οΈ Benefits

β€’ Competitive compensation β€’ Exceptional benefits package β€’ Flexible Vacation & Paid Time Off β€’ Employer-matched 401(k) plan β€’ Equity, bonuses, commission, or other forms of compensation may also be provided depending on the position offered β€’ Medical, financial, and other benefits

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ November 3

Berkeley Research Group (BRG)

1001 - 5000

πŸ—οΈ Construction

πŸ“¦ Logistics

πŸŽ–οΈ Defense

AI Product Engineer evaluating accuracy, safety, and reliability of banking AI products. Building automated tests and evidence for release decisions at BRG.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $180k - $250k / year

πŸ’° Venture Round on 2020-07

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ§‘β€πŸ’» Full-stack Engineer

πŸ•’ November 3

Airbnb

5001 - 10000

✈️ Travel

πŸ“¦ Logistics

πŸ›οΈ eCommerce

Senior Software Engineer building Airbnb’s high-scale marketing segmentation platform and agentic Growth Engine. Scaling backend services and leading projects from design through production.

πŸ•’ November 2

CopilotIQ

51 - 200

πŸ₯ Healthcare

☁️ SaaS

πŸ€– Artificial Intelligence

Senior Product Engineer building full-stack and LLM-powered features for CopilotIQ+Biofourmis’s AI-driven in-home healthcare platform. Owning product delivery, reliability, and patient-data safety end to end.

πŸ•’ November 2

Factory

51 - 200

☁️ SaaS

πŸ€– Artificial Intelligence

🏒 Enterprise

Software Engineer building AI agentic systems and secure deployments for Factory, a self-improving software platform. Supporting classified federal environments and government engineering teams.

πŸ•’ November 2

CVS Health

10,000+ employees

πŸ₯ Healthcare

βš•οΈ Healthcare Insurance

πŸ›’ Retail

Senior engineer building AI/ML, NLP, and cloud software for CVS Health’s Aetna healthcare technology products. Developing scalable platforms that support clinical and interoperability services.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok