Data Engineer – Databricks, BigQuery, Snowflake

🕒 il y a 3 mois

🇺🇸 États-Unis – Télétravail

⏰ Temps Plein

🟠 Senior

🔴 Expert

🚰 Ingénieur Data

🗣️🇺🇸🇬🇧 Anglais requis

Postuler Maintenant
Trouver des Emplois à Distance Similaires

📊 Vérifiez votre score de CV pour ce poste

Améliorez vos chances d'obtenir un entretien en vérifiant votre score de CV avant de postuler.

Logo of TENCYS

TENCYS

11 - 50 employés

Fondée en 2024

💼 Conseil

📦 Logistique

🏥 Santé

💰 €35 000 Pre seed en 2024-11

Consulting • Logistics • Healthcare

TENCYS est une entreprise technologique pilotée par l'IA qui développe des solutions d'intelligence artificielle agentiques, de modèles de langage de grande taille (LLM), et de logiciels d'entreprise pour automatiser et accélérer la prise de décision commerciale. Elle propose le développement de modèles AI/ML, des services d'analytique, de cloud et d'intégration, ainsi que des cadres et produits packagés (par exemple, Analytica 360, VeriX LLM, AgriGPT) pour des secteurs tels que l'agritech, la fintech, la santé et la logistique. TENCYS se concentre sur l'intégration de systèmes, l'innovation éthique et une prestation orientée client pour déployer des agents et des plateformes d'entreprise évolutives et autonomes.

Description

• Design, develop, and optimize scalable data pipelines using SQL, Python, and PySpark • Build and maintain ETL workflows to transform raw data into structured, analytics-ready datasets • Collaborate with data scientists to deploy and integrate machine learning models into production environments • Work with cloud platforms such as AWS and Azure to manage and scale data infrastructure • Utilize Databricks and Snowflake for big data processing and data warehousing solutions • Implement workflow orchestration using tools like Apache Airflow to automate data pipelines • Manage infrastructure as code using Terraform for scalable and reliable deployments • Optimize data storage, retrieval, and performance across data warehouse systems • Ensure data quality, governance, and compliance using tools like Unity Catalog or Hive Metastore • Troubleshoot and resolve data pipeline issues while continuously improving system performance

🎯 Exigences

• 8+ years of experience in data engineering or related roles • Strong proficiency in SQL and Python for data processing and pipeline development • Hands-on experience with PySpark and large-scale data processing • Experience with ETL frameworks and data pipeline architecture • Working knowledge of cloud platforms such as AWS and Azure • Experience with Databricks and Snowflake environments • Familiarity with workflow orchestration tools like Apache Airflow • Experience with Terraform or similar infrastructure-as-code tools • Strong understanding of data warehousing concepts and best practices • Excellent problem-solving, analytical, and communication skills • Experience integrating machine learning or AI models into data pipelines is preferred • Exposure to data governance and cataloging tools such as Unity Catalog or Hive Metastore is preferred • Experience working in large-scale enterprise or consulting environments is preferred • Knowledge of performance tuning and optimization for big data systems is a plus • Familiarity with real-time data processing frameworks is a plus.

🏖️ Avantages

• This is a remote position • Opportunity to work on innovative data solutions

Postuler Maintenant

Emplois Similaires

🕒 il y a 3 mois

Olsson

1001 - 5000

🏗️ Construction

Senior Fire Protection Engineer leading complex projects in data centers and secure facilities. Providing technical leadership on fire protection strategies for multidisciplinary teams.

🗣️🇺🇸🇬🇧 Anglais requis

🕒 il y a 3 mois

Olsson

1001 - 5000

🏗️ Construction

Mechanical Project Engineer managing data center projects for Olsson. Overseeing design, quality assurance, and collaboration with multidisciplinary teams.

🗣️🇺🇸🇬🇧 Anglais requis

🕒 il y a 3 mois

Olsson

1001 - 5000

🏗️ Construction

Electrical Instrumentation Engineer supporting design development of instrumentation and control systems for data centers. Providing technical leadership and mentoring within a collaborative engineering team.

🗣️🇺🇸🇬🇧 Anglais requis

🕒 il y a 3 mois

SentiLink

51 - 200

🔐 Sécurité

💳 Fintech

💸 Finance

Senior Software Engineer on the Data Platform team at SentiLink building data infrastructure for identity verification solutions. Collaborating with product and engineering on data platform enhancements.

🇺🇸 États-Unis – Télétravail

💵 $170 000 - $240 000 / an

💰 €70 000 000 Series B en 2021-08

⏰ Temps Plein

🟠 Senior

🚰 Ingénieur Data

🦅 Parrain de Visa H1B

info

🗣️🇺🇸🇬🇧 Anglais requis

🕒 il y a 3 mois

Chainlink Labs

201 - 500

💸 Finance

💳 Fintech

🌐 Web 3

Software Engineer on the Data Products team at Chainlink, designing and implementing decentralized data products for DeFi markets. Collaborating with experts to build a reliable decentralized infrastructure.

🇺🇸 États-Unis – Télétravail

⏰ Temps Plein

🟠 Senior

🚰 Ingénieur Data

🗣️🇺🇸🇬🇧 Anglais requis