Senior GCP Data Engineer

Job not on LinkedIn

🔥 0 minutes ago

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Compass

WebsiteLinkedInAll Job Openings

10,000+ employees

🏠 Real Estate

📱 Media

Real Estate • Media

Compass is a real-estate-focused content and services site that provides detailed market analysis, buying/selling/renting guides, mortgage and financing information, and home improvement and renovation advice. The site offers resources for homebuyers, sellers, renters, agents, and real estate investors — including articles on appraisals, affordable housing, investment strategies, staging and property maintenance. Compass aims to help users make informed decisions across the housing lifecycle through timely market updates and practical how-to content.

📋 Description

• Develop and maintain batch and streaming data pipelines in the Google Cloud Platform (GCP) environment; • Build ingestion and transformation workflows using Dataflow and Apache Beam; • Integrate data from multiple sources, including Oracle, SQL Server, MySQL, on-premises environments, and external buckets; • Work with BigQuery for data processing, transformation, and optimization; • Organize and structure data in Cloud Storage following a Data Lake architecture (Raw, Bronze, Silver, and Gold); • Orchestrate workflows and pipelines using Cloud Composer (Airflow); • Develop ETL/ELT processes and analytical transformations using SQL; • Build automations and data integrations using Python; • Ensure the quality and reliability of processed data; • Support initiatives to migrate reports and analytical assets to a new Data Visualization platform; • Collaborate with Engineering, Analytics, Data Science teams, and business stakeholders.

🎯 Requirements

• Experience with Google Cloud Platform (GCP); • Knowledge of BigQuery; • Experience with Dataflow and Apache Beam; • Experience with Cloud Storage and Pub/Sub; • Experience with Cloud Composer (Airflow) or equivalent orchestration tools; • Python skills for developing pipelines and ETL/ELT processes; • Advanced SQL for data transformation and manipulation; • Experience integrating data from relational databases such as Oracle, SQL Server, and MySQL; • Knowledge of Data Lake architecture (Raw, Bronze, Silver, and Gold); • Experience building and maintaining data pipelines; • Knowledge of Dataform, dbt, or similar tools (advantage); • Experience with streaming data processing (advantage); • Familiarity with data quality and governance best practices (advantage); • Experience in BI, Analytics, or Data Visualization migration projects (advantage); • Knowledge of performance and cost optimization in GCP environments (advantage).

🏖️ Benefits

• Health insurance • Retirement plan • Flexible working arrangements • Opportunities for professional development