Senior Data Engineer

🕒 Abril 26

🗽 New York – Remoto

🗽 New York – Remote

💵 $128.200 - $157.000 / ano

⏰ Tempo Integral

🟠 Sênior

🚰 Engenheiro de Dados

🦅 Patrocina Visto H1B

Esta empresa já patrocinou vistos H1B no passado.

Candidatar-se

Encontrar Vagas Remotas Similares

Receber Emails de Vagas Remotas

📊 Verifique sua pontuação de currículo para esta vaga

Melhore suas chances de conseguir uma entrevista verificando sua pontuação de currículo antes de se candidatar.

Enviar Currículo

Avaya

SiteLinkedInTodas as Vagas

5001 - 10000 funcionários

🤝 B2B

💰 Post-IPO Debt em 2022-06

AI • B2B • Communications

A Avaya é uma provedora líder de soluções de experiência do cliente e comunicação, capacitando empresas a inovar sem interrupções. A empresa oferece um conjunto abrangente de tecnologias impulsionadas por IA, projetadas para aprimorar as jornadas do cliente, otimizar o engajamento dos funcionários e impulsionar o crescimento dos negócios, garantindo interações consistentes e de alta qualidade em todos os canais. As plataformas da Avaya, como a Avaya Experience Platform e Communication & Collaboration Suite, facilitam a comunicação intercanal perfeita e fluxos de trabalho colaborativos para organizações em diversos setores.

Descrição

• Design, build, and operate low-latency streaming pipelines (Kafka, Spark Structured Streaming) and robust batch ETL/ELT on Databricks Lakehouse. • Establish reliable orchestration and dependency management (Airflow), with strong SLAs and on-call readiness for business-critical data flows. • Model, optimize, and document curated datasets and interfaces that serve analytics, product features, and AI workloads. • Implement data quality checks, observability, and backfills; drive root-cause analysis and incident prevention. • Partner with application teams (Go/Java), analytics, and ML/AI to ship data products into production. • Build and maintain datasets and services that power RAG pipelines and agentic AI workflows (tool-use/function calling). • When Spark/Databricks isn’t optimal, design and operate custom processors/services in Go to meet strict latency or specialized transformation requirements. • Instrument prompt/response and token usage telemetry to support LLMOps evaluation and cost optimization; provide datasets for labeling and golden sets. • Improve performance and cost (storage/compute), review code, and raise engineering standards.

🎯 Requisitos

• 6+ years building production-grade data pipelines at scale (streaming and batch). • Deep proficiency in Python and SQL; strong Spark experience on Databricks (or similar). • Advanced SQL: window functions, CTEs, partitioning/z-ordering, query planning and tuning in lakehouse environments. • Hands-on with Kafka (or equivalent) and an orchestrator (Airflow preferred). • Strong data modeling skills and performance tuning for low latency and high throughput. • Production mindset: SLAs, monitoring, alerting, CI/CD, and on-call participation. • Proficient using AI coding assistants (Cursor, Claude Code) as part of daily development. • Proficiency building data services/processors in Go (or willingness to ramp quickly), and familiarity with alternative frameworks (e.g., Flink/Beam) is a plus.

🏖️ Benefícios

• performance-related bonus • benefits