Senior Data Engineer

🕒 il y a 3 mois

🗽 New York – Distant

🗽 New York – Remote

💵 $128 200 - $157 000 / an

⏰ Temps Plein

🟠 Senior

🚰 Ingénieur Data

🦅 Parrain de Visa H1B

Cette entreprise a parrainé des visas H1B par le passé.

Postuler Maintenant

Trouver des Emplois à Distance Similaires

Configurer une alerte email pour les nouveaux emplois

📊 Vérifiez votre score de CV pour ce poste

Améliorez vos chances d'obtenir un entretien en vérifiant votre score de CV avant de postuler.

Télécharger le CV

Avaya

Site WebLinkedInTous les Emplois

5001 - 10000 employés

💼 Conseil

📣 Marketing

📦 Logistique

💰 Post-IPO Debt en 2022-06

Consulting • Marketing • Logistics

Avaya est un fournisseur de premier plan de solutions d'expérience client et de communication, permettant aux entreprises d'innover sans perturber leur fonctionnement. L'entreprise propose une suite complète de technologies pilotées par l'IA conçues pour améliorer les parcours clients, rationaliser l'engagement des employés et stimuler la croissance des entreprises, tout en garantissant des interactions cohérentes et de haute qualité sur tous les canaux. Les plateformes d'Avaya, telles que la Avaya Experience Platform et la Communication & Collaboration Suite, facilitent une communication inter-canaux fluide et des flux de travail collaboratifs pour les organisations de divers secteurs.

Description

• Design, build, and operate low-latency streaming pipelines (Kafka, Spark Structured Streaming) and robust batch ETL/ELT on Databricks Lakehouse. • Establish reliable orchestration and dependency management (Airflow), with strong SLAs and on-call readiness for business-critical data flows. • Model, optimize, and document curated datasets and interfaces that serve analytics, product features, and AI workloads. • Implement data quality checks, observability, and backfills; drive root-cause analysis and incident prevention. • Partner with application teams (Go/Java), analytics, and ML/AI to ship data products into production. • Build and maintain datasets and services that power RAG pipelines and agentic AI workflows (tool-use/function calling). • When Spark/Databricks isn’t optimal, design and operate custom processors/services in Go to meet strict latency or specialized transformation requirements. • Instrument prompt/response and token usage telemetry to support LLMOps evaluation and cost optimization; provide datasets for labeling and golden sets. • Improve performance and cost (storage/compute), review code, and raise engineering standards.

🎯 Exigences

• 6+ years building production-grade data pipelines at scale (streaming and batch). • Deep proficiency in Python and SQL; strong Spark experience on Databricks (or similar). • Advanced SQL: window functions, CTEs, partitioning/z-ordering, query planning and tuning in lakehouse environments. • Hands-on with Kafka (or equivalent) and an orchestrator (Airflow preferred). • Strong data modeling skills and performance tuning for low latency and high throughput. • Production mindset: SLAs, monitoring, alerting, CI/CD, and on-call participation. • Proficient using AI coding assistants (Cursor, Claude Code) as part of daily development. • Proficiency building data services/processors in Go (or willingness to ramp quickly), and familiarity with alternative frameworks (e.g., Flink/Beam) is a plus.

🏖️ Avantages

• performance-related bonus • benefits