Senior Data Engineer

🔥 0 minutes ago

🇧🇷 Brazil – Remote

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 10%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

SysMap Solutions

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 1999

💼 Consulting

📣 Marketing

🤖 Artificial Intelligence

Consulting • Marketing • Artificial Intelligence

SysMap Solutions is a services company devoted to offering technological development to its customers since 1997. With a focus on cloud solutions, Salesforce, mobile development, CRM, user experience, DevOps, machine learning, and digital transformation, SysMap Solutions leverages its extensive experience to craft complex codes and systems that meet client demands. The company prides itself on its ability to deliver tailored solutions, ensuring that the final product is precisely aligned with customer needs. In the Age of Information, SysMap Solutions stands out as a knowledgeable partner in technology.

📋 Description

• Design, develop, and maintain scalable, efficient data pipelines • Implement data ingestion, transformation, and integration processes using batch and streaming architectures • Develop and optimize solutions using Cloudera, Databricks, and AWS services • Create data processing and transformation routines using Python, SQL, and PySpark • Develop and maintain ETL/ELT processes • Work with Data Lake, Lakehouse, and distributed processing architectures • Integrate diverse data sources while ensuring information quality, consistency, and reliability • Monitor and optimize the performance of pipelines, jobs, and queries • Apply best practices in data security, governance, cataloging, and lineage • Contribute to the evolution of the data architecture and the continuous improvement of processes • Collaborate with architecture, analytics, data science, and business teams

🎯 Requirements

• Solid experience as a Senior Data Engineer • Knowledge of Cloudera and Databricks, with experience processing and transforming large volumes of data • Knowledge of AWS (Amazon Web Services) and its core services applied to data engineering • Advanced SQL skills and experience with Python and PySpark • Experience with Apache Spark and distributed processing • Knowledge of ETL/ELT processes and tools • Experience with Data Lake and Lakehouse architectures • Knowledge of data modeling and integrating diverse information sources • Experience with version control using Git • Knowledge of data pipeline monitoring, troubleshooting, and optimization • Experience with AWS data services such as Amazon S3, AWS Glue, Amazon Redshift, AWS Lambda, and Amazon Athena • Knowledge of data processing and orchestration services in cloud environments • Experience with Delta Lake and Hadoop ecosystem technologies such as Hive, HDFS, and Impala • Knowledge of Apache Kafka and real-time data processing • Experience with Apache Airflow or similar orchestration tools • Knowledge of CI/CD practices, infrastructure as code, and automation • Experience with data governance, quality, security, and observability • Experience working on data platform migration, modernization, and integration projects

🏖️ Benefits

• This position is also open to people with disabilities (PwD)