Senior Data Engineer, Data Lake

🔥 0 minutes ago

🇧🇷 Brazil – Remote

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 10%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Visa

WebsiteLinkedInAll Job Openings

10,000+ employees

💳 Fintech

💸 Finance

🏦 Banking

💰 Post IPO equity on 2016-10

Fintech • Finance • Banking

Visa is a global payments technology company that connects consumers, merchants, financial institutions and governments to enable electronic payments and commerce. It operates a worldwide card network for credit, debit and prepaid payments and provides payment processing, security and fraud-mitigation services, data analytics and value-added products for both consumers and businesses. Visa invests in next-generation payment solutions (including AI-driven commerce), supports financial inclusion initiatives through the Visa Foundation, and offers consumer card benefits and merchant services.

📋 Description

• Develop, test, and maintain data ingestion, transformation, and quality-check pipelines using PySpark/SparkSQL on Databricks • Build and modify Airflow DAGs (MWAA) for pipeline orchestration • Write and optimize SQL queries for data transformation and validation • Implement and monitor data quality checks using Great Expectations or equivalent • Participate in code reviews • Investigate pipeline failures and data quality issues with guidance from senior engineers • Write and maintain documentation for datasets and pipelines • Participate in sprint planning, estimation, and retrospectives • Follow team-defined CI/CD, testing, and governance standards • Contribute to the reliability and quality of Visa's corporate data lake

🎯 Requirements

• Must be based in Brazil • Proficiency in English at B2 level or above (Upper-Intermediate) • 3+ years of relevant work experience with a Bachelor's or Associate’s Degree OR 5+ years of relevant work experience • Python for automation and data processing • Data pipeline concepts (batch, ETL/ELT patterns) • Apache Spark basics (PySpark or SparkSQL) • Databricks (jobs, workflows, cluster management, tuning) • SQL (intermediate–advanced: joins, window functions, CTEs) • Amazon S3 data lake design (partitioning, layout, lifecycle) • Basic cloud concepts (AWS: S3, IAM, CloudWatch) • Data modeling (dimensional / Kimball, medallion layers) • Git/GitHub workflow and code review • Preferred: Delta Lake, Apache Airflow/MWAA, CDC patterns, data quality concepts, Terraform basics, BI integration (Superset, dashboarding))

🏖️ Benefits

• Remote work arrangement • Opportunity to create impact at scale • Skill growth and professional development through meaningful work • Scheduled-notice Visa office presence may be available for remote positions