Staff Data Engineer

Vaga não está no LinkedIn

🕒 Março 12

🗽 New York – Remoto

🗽 New York – Remote

⏰ Tempo Integral

🔴 Especialista

🚰 Engenheiro de Dados

Candidatar-se

Encontrar Vagas Remotas Similares

Receber Emails de Vagas Remotas

📊 Verifique sua pontuação de currículo para esta vaga

Melhore suas chances de conseguir uma entrevista verificando sua pontuação de currículo antes de se candidatar.

Enviar Currículo

VirtusLab

SiteLinkedInTodas as Vagas

201 - 500 funcionários

Fundada em 2010

💳 Fintech

💰 Private Equity Round em 2021-12

Fintech • Software Engineering • Cloud Engineering

A VirtusLab é uma empresa global de consultoria em tecnologia especializada em engenharia de software, consultoria de TI e experiência do desenvolvedor. A empresa foca em melhorar a eficiência e a inovação através de insights estratégicos, desenvolvimento de conceitos personalizados e suporte abrangente a projetos, especialmente em áreas como aprendizado de máquina, engenharia de nuvem e consultoria em Scala. Com um compromisso em impulsionar a evolução positiva na tecnologia de software, a VirtusLab ajuda empresas a otimizar suas pilhas tecnológicas e alcançar soluções escaláveis para suas necessidades de software.

Descrição

• building web crawling or large-scale data systems from scratch • designing scalable, fault-tolerant distributed systems • leading complex technical initiatives • mentoring engineers and promoting a collaborative culture • operating ETL/ELT pipelines • extracting structured/unstructured web data

🎯 Requisitos

• Proven experience building web crawling or large-scale data systems from scratch • Strong architectural skills in designing scalable, fault-tolerant distributed systems • Track record leading complex technical initiatives and driving architecture direction for teams • Demonstrated ability to evolve production systems incrementally while maintaining reliability • Experience mentoring engineers at all levels and promoting a collaborative culture • Deep background in large-scale data engineering (terabytes daily) • Hands-on experience with cloud data warehouses (BigQuery, Snowflake) • Experience with Apache Kafka, Kubernetes (GKE/EKS), and orchestration tools (Airflow) • Familiarity with multi-cloud environments (GCP + AWS) • Expertise in designing and operating ETL/ELT pipelines • Deep expertise in web crawling technologies and advanced scraping (Scrapy or similar) • Experience in extracting structured/unstructured web data and SERP extraction • Knowledge of proxy infrastructure management, anti-bot detection, and ethical crawling • Familiarity with crawling vendors and AI/LLM-based extraction approaches • Support the VirtusLab U.S. and international teams by lending senior technical expertise to client-facing activities, including technical discovery sessions, workshops, and solution architecture • Conduct requirements analysis and solution discovery, identifying business and technical needs • Provide technical consulting and advisory services, recommending appropriate data architectures aligned with customer goals • Prepare and review technical sections of commercial offers, including solution descriptions, statements of work (SoWs), project estimates, timelines, and delivery models

🏖️ Benefícios

• self-development opportunities • good working conditions