Senior Data Engineer

Job not on LinkedIn

🕒 June 5

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

SysMap Solutions

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 1999

SysMap Solutions is a services company devoted to offering technological development to its customers since 1997.

📋 Description

• Design and implement data ingestion, transformation, and orchestration pipelines on Google Cloud; • Ensure quality, reliability, and scalability of data flows (batch and streaming); • Optimize storage and processing costs (BigQuery, Dataflow, Dataproc, Pub/Sub); • Collaborate with data scientists and analysts, providing production-ready data.

🎯 Requirements

• Data Ingestion • - Dataflow (Apache Beam) → scalable ETL/ELT pipelines. Extraction from external sources such as Oracle databases on OCI, on-premise SQL Server; • - Pub/Sub → real-time ingestion; • - Storage Transfer → batch ingestion of data originating in GCS or external sources such as AWS S3 buckets; • - Integration with external databases (Oracle, SQL Server, MySQL) via JDBC / Dataflow templates or custom extraction. • Storage and Processing • - BigQuery → modeling, query optimization, partitioning and clustering; • - Cloud Storage → Data Lake (raw, bronze, silver, gold); • - Dataproc when needed; • - Bigtable and Firestore for NoSQL use cases. • Transformation and Modeling • - Dataform or dbt for SQL orchestration on BigQuery; • - Best practices in dimensional modeling; • - Batch and streaming processing (Beam, SQL streaming). • Orchestration and Automation • - Cloud Composer (Airflow) or Workflows for complex scheduling; • - Integration with Cloud Functions / Cloud Run for serverless tasks; • Languages and Tools • - Advanced SQL (BigQuery SQL); • - Python (for Dataflow, automations, ETL); • - Git (CI/CD in repositories).

🏖️ Benefits

• Position also open to candidates with disabilities (PwD)