Data Engineer – GCP

🔥 41 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

The Data Sherpas

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2010

💼 Consulting

🤖 Artificial Intelligence

📣 Marketing

Consulting • Artificial Intelligence • Marketing

The Data Sherpas is a platform-agnostic data and analytics services firm that helps organizations adopt AI, cloud, martech and adtech solutions. Innovation-focused, they provide consulting and managed services to empower businesses with advanced data, AI and cloud capabilities for strategic decision-making, operational efficiency and competitive advantage. Their website emphasizes case studies, brand partnerships, and services spanning data, AI, cloud, martech and adtech.

📋 Description

• Design, build, and maintain scalable and reliable data pipelines using Cloud Dataflow, Cloud Pub/Sub, and Cloud Composer. • Develop ETL/ELT processes to process and transform large volumes of structured and unstructured data. • Optimize data pipeline performance, scalability, and reliability. • Ensure data processing and ingestion workflows are monitored and meet performance SLAs. • Design and implement data storage solutions using BigQuery, Cloud Storage, and Firestore. • Manage data lifecycle policies and archiving processes. • Develop data transformation processes using BigQuery, Apache Beam, and Cloud Functions. • Implement data quality checks, validation rules, and monitoring solutions. • Automate data ingestion, transformation, and export using tools like Cloud Composer and Cloud Functions. • Collaborate with data scientists and analysts to understand data needs and business goals.

🎯 Requirements

• Bachelor’s degree in Computer Science, Data Engineering, or a related field; Master’s degree is a plus. • 3+ years of experience in data engineering, with at least 2+ years working with Google Cloud Platform. • Google Professional Data Engineer certification is required. • Strong proficiency with GCP services such as BigQuery, Cloud Dataflow, Cloud Composer, Cloud Pub/Sub, Firestore, and Cloud Functions. • Hands-on experience with big data tools and frameworks such as Apache Beam, Hadoop, Spark, or Flink. • Hands-on experience with dbt. • Proficiency in programming languages such as Python, Java, or Scala. • Strong knowledge of SQL, data modeling, and query optimization. • Experience with CI/CD tools and version control (e.g., Git, Cloud Build). • Strong understanding of data governance, security, and compliance requirements. • Ability to manage large-scale data processing and real-time data pipelines. • Excellent problem-solving, analytical, and communication skills. • Must be a U.S. Citizen or Green Card holder.

🏖️ Benefits

• Competitive salary and performance-based incentives. • Comprehensive health, dental, and vision coverage. • Professional development and training opportunities (including GCP certification). • Flexible work environment and remote work options.