Senior Data Engineer

🕒 June 24

🇧🇷 Brazil – Remote

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 55%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Zup Innovation

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

📣 Marketing

🔌 API

💼 Consulting

Marketing • API • Consulting

Zup Innovation is a tech company with over 12 years of experience, specializing in building secure and scalable systems using distributed architectures and cloud-native solutions. They focus on helping large market players enhance their application development, achieving faster time-to-market with significant reductions in coding requirements. Additionally, Zup Innovation offers high-tech consulting services and developed StackSpot, an enterprise developer platform designed for creating, sharing, and reusing technology standards from ideation to deployment.

📋 Description

• Participate in understanding business needs, ensuring value is delivered • Design architecture and evaluate available technologies to solve the right problem • Develop and enhance scalable data pipelines designed to support Generative AI models and RAG solutions • Implement data pipelines to democratize data within a Data Mesh architecture, creating semantic layers and structured data for AI consumption • Combine architecture and technology to develop and deliver reusable components such as connectors, APIs, SDKs, and CLIs, integrating with LLM APIs (OpenAI, Claude, Gemini) • Prototype intelligent agents using LangChain, LangGraph, and CrewAI, evaluating the cost, latency, and quality of integrations • Test and automate everything possible • Validate and adapt components based on user feedback • Contribute to the product’s technological quality and innovation, as well as to the work environment

🎯 Requirements

• Knowledge of large-scale data processing and parallel and distributed processing (Apache Spark, Hadoop, Hive, etc.) • Hands-on experience with ELT using dbt, Data Lake/Lakehouse architectures, and orchestration with Airflow • Experience with AWS Data & Analytics services (Glue, EMR, Athena, QuickSight) • Knowledge of Python • Proficiency with core AWS Cloud services (S3, Lambda, SQS, DynamoDB, API Gateway) • Proficiency using LLMs, applying embeddings, RAG (Retrieval-Augmented Generation), and vector databases (Pinecone, Milvus, pgvector, Qdrant, etc.) • Expertise in Prompt Engineering and orchestration with frameworks such as LangChain or LangGraph • Solid hands-on experience with relational databases (SQL) and NoSQL databases (document and key-value) • Expertise in DevOps practices and infrastructure as code (Terraform, CodePipeline, etc.) • Previous experience with data democratization initiatives using Data Mesh would be a strong plus • Experience benchmarking different LLMs available on the market, considering cost-effectiveness and latency, would be a strong plus • Experience with Generative AI or automation tools applied to data pipelines would be a strong plus • Knowledge of observability tools and practices (CloudWatch, CloudTrail, Prometheus, AppDynamics, Splunk, Elasticsearch, Grafana, etc.) would be a strong plus • Knowledge of advanced caching techniques for scalable AI systems would be a strong plus • Experience developing solutions for financial institutions would be a strong plus

🏖️ Benefits

• Freedom to work from wherever you choose • Flexible working hours* • Education allowance • Dedicated career development platform • Internal guilds and other study and interest groups • Health insurance • Dental insurance • Discounted prescription medication program • Telemedicine: 24/7 medical assistance • Free online therapy • Wellhub • Extended maternity leave • Extended paternity leave • CAZ – Zuppers Support Center • Meal and food allowance • Life insurance • Transportation allowance • Home office allowance • Childcare allowance • Phone plan allowance • Profit-sharing program