Senior Data Engineer, GCP/dbt

Job not on LinkedIn

🔥 1 minute ago

🇧🇷 Brazil – Remote

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 15%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Leega

WebsiteLinkedInAll Job Openings

201 - 500 employees

Founded 2010

💼 Consulting

📣 Marketing

🔌 API

Consulting • Marketing • API

Leega is a leading technology solutions provider in Latin America, specializing in data analytics and cloud solutions. As the first company in the region certified by Google Cloud for Data Analytics, Leega offers a range of services including application development, machine learning, and risk management analytics. The firm partners with major cloud services such as AWS and Microsoft Azure to help businesses enhance their data management and transition effectively to the cloud, ultimately driving digital transformation and innovation.

📋 Description

• Serve as a Senior Data Engineer on the collections squad of a large financial institution • Build and enhance cloud-based data pipelines and models using dbt • Participate in a data community of practice (chapter) and promote best practices • Support business teams in advancing their data maturity • Collaborate continuously with Data Science, BI, Data Engineering, and business teams • Diagnose issues, propose standards, and document solutions • Assess data warehouse architecture and requirements • Map data, transformations, and processes across GCP services • Define full-load, incremental, and CDC migration strategies • Develop a data architecture plan on GCP • Design BigQuery table schemas with performance, cost, and scalability in mind • Define BigQuery partitioning and clustering strategies • Model Bronze, Silver, and Gold zones in Cloud Storage • Create transformations using Dataproc/Spark or Dataflow to load data into BigQuery • Translate existing business logic and transformations in GCP • Implement data validation and quality processes • Use Terraform to provision and manage GCP resources • Configure and optimize Dataproc clusters • Manage networking, IAM security, and access controls in GCP • Optimize BigQuery queries, Spark jobs, and GCP resource utilization • Implement data security in transit and at rest • Define and enforce IAM policies and ensure compliance with data governance requirements • Troubleshoot performance and functional issues affecting pipelines and GCP resources • Document architecture, pipelines, models, and operational procedures • Communicate with team members, stakeholders, and other departments • Ensure clear communication between architecture, software components, and ongoing development efforts

🎯 Requirements

• At least 3 years of proven experience with GCP • At least 3 years of proven experience with dbt • At least 3 years of proven experience with PySpark • Proven knowledge of GitFlow • In-depth knowledge of BigQuery, including data modeling, query optimization, partitioning, clustering, streaming and batch loads, security, and governance • Experience with Cloud Storage, including buckets, storage classes, lifecycle policies, IAM, and data security • Ability to provision, configure, and manage Spark/Hadoop clusters on Dataproc • Knowledge of Dataflow, Composer, and dbt for ELT/ETL pipelines • Experience implementing Cloud IAM policies and granular access controls • Understanding of VPCs, networking, subnets, firewalls, and cloud security • Python and PySpark • Advanced SQL • Shell scripting • Git, GitHub, and Bitbucket • Knowledge of Agile methodologies, ceremonies, and proficiency with Jira

🏖️ Benefits

• Porto Seguro health insurance, with the option to add a spouse and children • Porto Seguro dental insurance for employees and dependents • Profit Sharing and Results (PLR) • Childcare assistance • Alelo meal and food vouchers • Home office allowance • Partnerships with educational institutions, offering discounts and incentives for courses and degree programs • Certification incentives, including cloud certifications such as GCP, Azure, AWS, and others • Livelo points • TotalPass, offering discounted gym memberships for employees and family members • Mindself, with incentives for meditation and mindfulness • Ongoing training and professional development