Data Engineer

🕒 il y a 14 jours

🗽 New York – Distant

🗽 New York – Remote

💵 $140 000 - $180 000 / an

⏰ Temps Plein

🟡 Intermédiaire

🟠 Senior

🚰 Ingénieur Data

Postuler Maintenant

Trouver des Emplois à Distance Similaires

Configurer une alerte email pour les nouveaux emplois

📊 Vérifiez votre score de CV pour ce poste

Améliorez vos chances d'obtenir un entretien en vérifiant votre score de CV avant de postuler.

Télécharger le CV

Reality Defender (YC W22)

Site WebLinkedInTous les Emplois

11 - 50 employés

🤖 Intelligence artificielle

🔐 Sécurité

📱 Médias

Artificial Intelligence • Security • Media

Reality Defender est une entreprise qui fournit des plateformes multi-modèles et multimodales pour détecter le contenu généré par l'IA. Elle offre des services aux entreprises, gouvernements et plateformes pour détecter les deepfakes et les médias synthétiques à travers diverses modalités telles que l'audio, la vidéo, les images et le texte. Les solutions sont conçues pour se protéger contre la menace croissante du contenu généré par l'IA utilisé pour la fraude et la désinformation. Les outils de Reality Defender sont probabilistes, ce qui signifie qu'ils ne reposent pas sur des filigranes ou une authentification préalable pour vérifier l'authenticité. L'entreprise se concentre sur des industries comme les médias, la finance et le gouvernement pour se protéger contre les menaces générées par l'IA.

Description

• Design, build, and operate large-scale data processing pipelines handling multi-terabyte and streaming datasets, including audio/video transcoding, feature extraction, and preprocessing workflows. • Deploy, scale, and troubleshoot containerized workloads on Kubernetes and AWS in production environments. • Build and maintain distributed data processing jobs using frameworks such as Spark and Ray. • Design and operate workflow orchestration systems (e.g., Airflow) with dependency management, retries, monitoring, and alerting for production pipelines. • Administer and tune enterprise databases, including performance tuning, backup/recovery, access control, and scaling strategies. • Partner with ML engineers and researchers to support training pipelines, model retraining triggers, feature stores, and other MLOps workflows.

🎯 Exigences

• Hands-on experience with Kubernetes and AWS, including deploying, scaling, and troubleshooting containerized workloads in production environments. • Proficiency with high-performance/distributed computing frameworks such as Spark and Ray for processing large-scale datasets. • Experience with workflow orchestration tools such as Airflow (or comparable systems like Dagster, Prefect, or Luigi) to schedule and manage complex data pipelines. • Strong programming skills in Python and SQL; experience with Golang is a plus. • Demonstrated track record building and operating large-scale data processing pipelines, ideally handling multi-terabyte or streaming datasets. • Experience working with audio or video data at scale is a strong plus (e.g., transcoding, feature extraction, or preprocessing pipelines). • Familiarity with common data transformation patterns applied to large datasets (ETL/ELT, batch and stream processing, data validation and quality checks). • Experience designing and maintaining job orchestration systems, including dependency management, retries, monitoring, and alerting for production pipelines. • Bonus: experience orchestrating machine learning workflows (training pipelines, model retraining triggers, feature stores, or MLOps tooling).

🏖️ Avantages

• Healthcare plans with 100% premium coverage for employees and partial coverage available for dependents • Dental and Vision plans with 100% premium coverage for employees and their dependents • Short/Long-term disability and life insurance plans with 100% premium coverage for employees • FSA/HSA and 401k programs • Equity compensation • 20 days of PTO per year • 12 weeks of Parental Leave • Learning and Development budget • Monthly wellness benefits • Annual company-sponsored offsite • Daily in-office lunch through UberEats • Commuter benefits • Remote Fridays • Happy Hours and other local events