Senior Data Engineer – Databricks

🔥 il y a 14 heures

🇺🇸 États-Unis – Télétravail

💵 $155 000 - $185 000 / an

⏰ Temps Plein

🟠 Senior

🚰 Ingénieur Data

🦅 Parrain de Visa H1B

Cette entreprise a parrainé des visas H1B par le passé.

Postuler Maintenant

Trouver des Emplois à Distance Similaires

Configurer une alerte email pour les nouveaux emplois

📊 Vérifiez votre score de CV pour ce poste

Améliorez vos chances d'obtenir un entretien en vérifiant votre score de CV avant de postuler.

Télécharger le CV

SugarCRM

Site WebLinkedInTous les Emplois

501 - 1000 employés

Fondée en 2004

💼 Conseil

📣 Marketing

☁️ SaaS

💰 Private Equity Round en 2018-08

Consulting • Marketing • SaaS

SugarCRM est un fournisseur de premier plan de logiciels de gestion de la relation client (CRM) qui s'adresse aux fabricants B2B et à d'autres industries. L'entreprise propose des solutions conçues pour rationaliser des cycles de vente complexes et améliorer le service à la clientèle grâce à une automatisation avancée et des analyses alimentées par l'IA. SugarCRM offre une vue unifiée des données client, aidant les entreprises à améliorer leurs processus décisionnels et à prédire la performance des ventes. Leur plateforme prend en charge les intégrations avec des systèmes modernes et hérités, répondant à divers besoins commerciaux. SugarCRM propose également des services d'automatisation du marketing et d'intelligence des revenus, faisant de lui un choix CRM complet pour les entreprises cherchant à améliorer la productivité et l'engagement client.

Description

• Own Databricks production support for the Sugar Predict data platform, including monitoring, alerting, and incident response across production data flows • Maintain and report SLA performance metrics for data pipeline delivery • Identify and implement pipeline optimizations to reduce Databricks compute costs, improve throughput, and reduce processing windows • Migrate legacy ETL/ELT pipelines to Databricks and build automation tooling for uninterrupted data delivery • Support new customer onboarding by provisioning, validating, and hardening tenant data pipelines • Design and build Databricks pipelines ingesting, transforming, and serving ERP and CRM data across Azure and AWS • Own Delta Lake architecture, including schema design, partitioning, data quality enforcement, and incremental processing • Enforce data security best practices, including role-based access control, secrets management, and compliance requirements • Implement data quality monitoring and observability for pipelines and ML model inputs • Apply multi-tenant data isolation patterns for secure, reliable customer data delivery • Partner with Enterprise Architecture to integrate pipelines with the SugarAI product ecosystem • Participate in on-call rotation and after-hours incident response across multiple time zones • Maintain technical documentation, runbooks, and architectural decision records • Apply CI/CD practices including version control, automated testing, and deployment tooling

🎯 Exigences

• 4+ years of data engineering experience • At least 2 years on Databricks or the Apache Spark ecosystem across Azure and/or AWS • Proficiency in PySpark, SQL, and Python • Track record building and operating production-grade pipelines under SLA constraints • Hands-on experience with Delta Lake, including schema evolution, ACID transactions, optimize/vacuum lifecycle, and incremental and streaming processing • Experience with pipeline performance tuning and compute optimization in production Databricks environments • Working knowledge of PostgreSQL, including query optimization, schema design, and production pipeline source/sink use • Experience supporting and maintaining legacy ETL tooling such as SSIS, Informatica, or custom Python/SQL pipelines • Experience supporting large-scale multi-tenant architectures, tenant isolation, per-tenant performance, and data privacy • Ability to collaborate across data science, product, and infrastructure teams and own end-to-end delivery • Understanding of data governance, security, and compliance principles • Preferred: Databricks workspaces across Azure and AWS, Serverless optimization, Microsoft SQL Server, ML feature engineering or feature stores, customer onboarding automation or IaC, and Databricks Certified Data Engineer certification

🏖️ Avantages

• Excellent healthcare package for you and your family • 401(k) match • Unlimited Paid Time Off • Paid Parental Leave • Online Legal Services (Rocket Lawyer) • Financial Planning Services (Origin) • Discounted Pet Insurance (Embrace Pet Insurance) • Corporate Benefit Program (Working Advantage), offering exclusive travel and entertainment offers and special discounts • Health and Wellness Reimbursement Program • Travel Discounts • Educational Resources - Career & Personal Development Program • Employee Referral Bonus Program • Opportunities to learn, excel and grow your career