Staff Data Platform Engineer

🕒 October 16

Where this job comes from

Posted on Reality Defender (YC W22)'s careers page ↗Reality Defender (YC W22)'s careers page, not through a job board

First seen by Remote Rocketship October 16

Still open on Reality Defender (YC W22)'s site. Checked 1 hour ago.

Apply Now
Logo of Reality Defender (YC W22)

Reality Defender (YC W22)

11 - 50 employees

🤖 Artificial Intelligence

🔐 Security

📱 Media

Artificial Intelligence • Security • Media

Reality Defender is a company that provides multi-model and multimodal platforms for detecting AI-generated content. It offers services to enterprises, governments, and platforms to detect deepfakes and synthetic media across various modalities such as audio, video, images, and text. The solutions are designed to protect against the rapidly growing threat of AI-generated content used for fraud and disinformation. Reality Defender's tools are probabilistic, meaning they do not rely on watermarks or prior authentication to verify authenticity. The company focuses on industries like media, finance, and government to safeguard against AI-generated threats.

📋 Description

• Own the end-to-end data platform for AI research, including continuous ingestion, preprocessing, governance, and export of image, video, audio, and text data at high volume • Complete and scale the Databricks lakehouse and distributed processing stack • Make architecture and build-vs-buy decisions as data volume grows • Build reusable infrastructure for in-house synthetic data generation across modalities • Implement dataset versioning, lineage, metadata, quality checks, and stable train/evaluation splits • Own pipeline reliability, observability, and processing cost per dataset • Partner with ML researchers to create self-serve tools that speed model iteration • Mentor engineers and improve code review, testing, documentation, and runbooks • Work with Security and compliance stakeholders on data handling, licensing, and access controls • Shape the long-term data platform roadmap with engineering and research leadership • Report to the Director of Data • Within 12 months, own a mature self-serve platform, scale synthetic data generation, deliver reproducible evaluation datasets, and lead high-leverage roadmap initiatives

🎯 Requirements

• 8+ years building data platforms or data infrastructure, including staff- or lead-level ownership of production pipelines that generate, ingest, or deliver data at high volume • Deep hands-on experience with distributed processing (Spark, Ray, or similar) and lakehouse platforms, ideally Databricks, on top of cloud object storage (S3, GCS, or Azure Blob) • Production experience with Databricks, Unity Catalog, Delta Lake, and Spark on AWS, including performance tuning, access controls, and operational troubleshooting • Experience working with large unstructured media such as video, audio, or images, including large files, decoding and transcoding, and metadata at scale • Track record of building reproducible ML datasets: versioning, lineage, data quality validation, and orchestration (Airflow, Dagster, Databricks Workflows, or similar) • Strong Python and SQL • Judgment to own ambiguous platform problems end-to-end on a lean team • Infrastructure and deployment automation using Terraform and CI/CD, including AWS storage, IAM, compute, Databricks resources, and distributed processing environments • Experience building synthetic data generation pipelines or running generative models at scale (nice to have) • Background supporting ML research teams with training and evaluation data, especially for multimodal models (nice to have) • Experience in security, fraud, trust & safety, or another adversarial domain, or at a Series A or B startup (nice to have) • Authorization to work in the U.S. is requested in the application • Willingness to relocate if not currently located in or near NYC, depending on work arrangement

🏖️ Benefits

• Healthcare plans with 100% premium coverage for employees and partial coverage available for dependents • Dental and Vision plans with 100% premium coverage for employees and their dependents • Short/Long-term disability and life insurance plans with 100% premium coverage for employees • FSA/HSA and 401k programs • Equity compensation • 20 days of PTO per year • 12 weeks of Parental Leave • Learning and Development budget • Monthly wellness benefits • Annual company-sponsored offsite • Daily in-office lunch through UberEats for NYC HQ employees • Commuter benefits for NYC HQ employees • Remote Fridays for NYC HQ employees • Happy Hours and other local events for NYC HQ employees • Eligibility for annual performance bonus

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 October 16

Buildertrend

501 - 1000

🏗️ Construction

☁️ SaaS

⚡ Productivity

Senior Data Engineer leading Buildertrend's Databricks and dbt lakehouse migration. Building reliable, governed datasets for construction management analytics and AI.

🇺🇸 United States – Remote

💵 $130k - $160k / year

💰 Series unknown on 2021-02

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

🕒 October 16

Quantiphi

1001 - 5000

💼 Consulting

🏥 Healthcare

📦 Logistics

Senior Data Engineer building Snowflake data platforms for Quantiphi, an AI-first digital engineering company. Supporting structured-credit analytics, legacy migrations, and cloud-native financial data pipelines.

🕒 October 16

Quantiphi

1001 - 5000

💼 Consulting

🏥 Healthcare

📦 Logistics

Senior Data Engineer building Snowflake, Dagster, and AWS data platforms for Asset-Backed Finance analytics at Quantiphi. Supporting enterprise pipelines, legacy migrations, and portfolio reporting.

🕒 October 16

Accenture Federal Services

10,000+ employees

💼 Consulting

🎖️ Defense

📦 Logistics

Data Platform Engineer supporting US federal missions through Databricks, GitLab, Python, and API integrations. Managing repositories, CI pipelines, and engineering activity analytics.

🕒 October 16

Sony Interactive Entertainment

10,000+ employees

🎮 Gaming

🔧 Hardware

📡 Telecommunications

Staff Data Software Engineer building PlayStation’s real-time analytics platforms. Leading distributed systems architecture, streaming infrastructure, and AI-powered developer productivity.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok