Senior Data Engineer

🔥 14 hours ago

🇧🇷 Brazil – Remote

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 10%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

SysMap Solutions

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 1999

💼 Consulting

📣 Marketing

🤖 Artificial Intelligence

Consulting • Marketing • Artificial Intelligence

SysMap Solutions is a services company devoted to offering technological development to its customers since 1997. With a focus on cloud solutions, Salesforce, mobile development, CRM, user experience, DevOps, machine learning, and digital transformation, SysMap Solutions leverages its extensive experience to craft complex codes and systems that meet client demands. The company prides itself on its ability to deliver tailored solutions, ensuring that the final product is precisely aligned with customer needs. In the Age of Information, SysMap Solutions stands out as a knowledgeable partner in technology.

📋 Description

• Design, develop, and maintain data infrastructure and architecture for the Legal department’s Artificial Intelligence initiatives • Design, develop, and maintain robust, scalable, and efficient data pipelines • Ingest, extract, transform, cleanse, standardize, and enrich large volumes of data • Structure and implement Lakehouse and Medallion architectures (Bronze, Silver, and Gold) • Transform raw data into structured and reliable data products, with a focus on the Gold layer • Prepare and make data available for Artificial Intelligence, Machine Learning, and LLM solutions • Develop ETL/ELT processes for integrating structured and unstructured data • Implement data validation, quality, traceability, and monitoring processes • Structure and prepare legal, litigation, contractual, and document data • Develop solutions for processing large volumes of documents and unstructured information • Collaborate with Data Scientists, AI professionals, Technology teams, and Legal specialists • Ensure security, governance, access control, and compliance with Brazil’s LGPD data protection law • Identify opportunities to optimize performance, costs, and efficiency across the data infrastructure

🎯 Requirements

• Solid experience in Data Engineering and data solution architecture • Proficiency in SQL and Python for data manipulation, transformation, and processing • Experience developing ETL/ELT pipelines • Knowledge of Lakehouse architecture and the Medallion model (Bronze, Silver, and Gold) • Experience with Apache Spark and PySpark • Knowledge of cloud-based data storage and processing platforms • Experience integrating and processing structured and unstructured data • Knowledge of data modeling and building Data Lakes and Data Warehouses • Experience with pipeline orchestration tools such as Apache Airflow or similar technologies • Knowledge of data governance, quality, lineage, and security • Familiarity with preparing data for Machine Learning models and Large Language Models (LLMs) • Experience with Generative Artificial Intelligence projects and LLM-based solutions (a plus) • Knowledge of Retrieval-Augmented Generation (RAG) architectures (a plus) • Experience with document processing, OCR, and extracting and structuring textual information (a plus) • Knowledge of vector databases and embedding techniques (a plus) • Experience working with legal, litigation, contractual, or banking-sector data (a plus) • Knowledge of data and AI services on AWS, Azure, or Google Cloud (a plus) • Experience with DataOps and CI/CD practices applied to Data Engineering (a plus)

🏖️ Benefits

• This position is also open to people with disabilities (PwD)

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume