Data Engineer, AWS – Databricks

🔥 0 minutes ago

🇧🇷 Brazil – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

☁️ Cloud Engineer

👻 Ghost score 10%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

SysMap Solutions

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 1999

💼 Consulting

📣 Marketing

🤖 Artificial Intelligence

Consulting • Marketing • Artificial Intelligence

SysMap Solutions is a services company devoted to offering technological development to its customers since 1997. With a focus on cloud solutions, Salesforce, mobile development, CRM, user experience, DevOps, machine learning, and digital transformation, SysMap Solutions leverages its extensive experience to craft complex codes and systems that meet client demands. The company prides itself on its ability to deliver tailored solutions, ensuring that the final product is precisely aligned with customer needs. In the Age of Information, SysMap Solutions stands out as a knowledgeable partner in technology.

📋 Description

• Develop and enhance Data Engineering solutions using Databricks and AWS • Administer and enhance Unity Catalog • Structure catalogs, schemas, tables, volumes, and other data objects • Implement and administer access controls and permissions using Unity Catalog • Support the definition and implementation of data security and governance policies • Work with Data Lineage, data discovery, and data traceability • Develop and maintain batch data pipelines and, where applicable, streaming pipelines • Develop transformations using SQL, Python, and PySpark • Work with Delta Lake / Delta Tables and Lakehouse architecture • Integrate data sources using AWS services and Databricks platform components • Ensure data quality, reliability, security, and availability • Support the definition of architecture standards and best practices for Databricks usage • Monitor and optimize data workload performance and costs • Collaborate with Data Engineering, Data Science, Analytics, Architecture, Security, and Governance teams

🎯 Requirements

• Solid experience with Databricks • Strong hands-on experience with Unity Catalog • Knowledge of catalogs and schemas • Knowledge of tables and views • Knowledge of volumes • Knowledge of access controls and privileges • Knowledge of GRANT/REVOKE • Knowledge of Data Lineage • Knowledge of data asset organization and governance • Knowledge of integration with identity and security systems • Knowledge of governance best practices in corporate environments • Experience with Delta Lake • Knowledge of Apache Spark and/or PySpark • Experience with Databricks Workflows/Jobs • Knowledge of workload optimization and performance tuning

🏖️ Benefits

• No specific benefits, additional benefits, or extra compensation were provided.