Data Engineer – GCP

🕒 il y a 8 jours

Postuler Maintenant

Trouver des Emplois à Distance Similaires

Configurer une alerte email pour les nouveaux emplois

📊 Vérifiez votre score de CV pour ce poste

Améliorez vos chances d'obtenir un entretien en vérifiant votre score de CV avant de postuler.

Télécharger le CV

The Data Sherpas

Site WebLinkedInTous les Emplois

11 - 50 employés

Fondée en 2010

💼 Conseil

🤖 Intelligence artificielle

📣 Marketing

Consulting • Artificial Intelligence • Marketing

The Data Sherpas est une entreprise de services de données et d'analytique, indépendante de toute plateforme, qui aide les organisations à adopter des solutions d'IA, de cloud, de martech et d'adtech. Axée sur l'innovation, elle fournit des services de conseil et des services gérés pour renforcer les entreprises grâce à des capacités avancées en matière de données, d'IA et de cloud, afin de faciliter la prise de décisions stratégiques, d'améliorer l'efficacité opérationnelle et de procurer un avantage concurrentiel. Son site web met en avant des études de cas, des partenariats de marque et des services couvrant les données, l'IA, le cloud, le martech et l'adtech.

Description

• Design, build, and maintain scalable and reliable data pipelines using Cloud Dataflow, Cloud Pub/Sub, and Cloud Composer. • Develop ETL/ELT processes to process and transform large volumes of structured and unstructured data. • Optimize data pipeline performance, scalability, and reliability. • Ensure data processing and ingestion workflows are monitored and meet performance SLAs. • Design and implement data storage solutions using BigQuery, Cloud Storage, and Firestore. • Manage data lifecycle policies and archiving processes. • Develop data transformation processes using BigQuery, Apache Beam, and Cloud Functions. • Implement data quality checks, validation rules, and monitoring solutions. • Automate data ingestion, transformation, and export using tools like Cloud Composer and Cloud Functions. • Collaborate with data scientists and analysts to understand data needs and business goals.

🎯 Exigences

• Bachelor’s degree in Computer Science, Data Engineering, or a related field; Master’s degree is a plus. • 3+ years of experience in data engineering, with at least 2+ years working with Google Cloud Platform. • Google Professional Data Engineer certification is required. • Strong proficiency with GCP services such as BigQuery, Cloud Dataflow, Cloud Composer, Cloud Pub/Sub, Firestore, and Cloud Functions. • Hands-on experience with big data tools and frameworks such as Apache Beam, Hadoop, Spark, or Flink. • Hands-on experience with dbt. • Proficiency in programming languages such as Python, Java, or Scala. • Strong knowledge of SQL, data modeling, and query optimization. • Experience with CI/CD tools and version control (e.g., Git, Cloud Build). • Strong understanding of data governance, security, and compliance requirements. • Ability to manage large-scale data processing and real-time data pipelines. • Excellent problem-solving, analytical, and communication skills. • Must be a U.S. Citizen or Green Card holder.

🏖️ Avantages

• Competitive salary and performance-based incentives. • Comprehensive health, dental, and vision coverage. • Professional development and training opportunities (including GCP certification). • Flexible work environment and remote work options.