Data Engineering Specialist – Data Platform

Job not on LinkedIn

🔥 4 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Casas Bahia Tecnologia

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 2021

Aqui você vai encontrar o dia a dia do time de tecnologia do Grupo Casas Bahia

📋 Description

• Design and develop the next generation of the company's data ingestion platform. • Define and evolve an AI-driven data ingestion architecture. • Build and maintain intelligent (ETL/ELT) ingestion pipelines that are scalable, reusable and resilient. • Incorporate AI agents for automation, orchestration and intelligent data validation. • Develop solutions based on RAG (Retrieval-Augmented Generation), embeddings and vector search. • Integrate multiple data sources: APIs, databases, events, SaaS and files (structured and unstructured). • Work with large-scale batch and streaming data processing. • Ensure data quality, reliability, governance and observability. • Apply anomaly detection techniques and intelligent pipeline validation. • Automate data integration and operations processes. • Establish best practices, standards and guidelines for data ingestion and Data Platforms. • Collaborate closely with Engineering, Analytics, Data Science, Product and Business teams. • Deliver high-impact business solutions with technical autonomy and ownership.

🎯 Requirements

• Strong experience with Databricks (Jobs, Clusters, Unity Catalog). • Solid experience building data ingestion pipelines (ETL/ELT). • Experience with distributed processing (Spark) for both batch and streaming (Kafka, Spark Streaming, etc.). • Experience with cloud platforms (AWS, Azure or GCP). • Familiarity with workflow orchestrators (Airflow, Dagster or similar). • Hands-on experience developing AI agents or RAG-based systems. • Knowledge of LLMs (Large Language Models) and frameworks such as LangChain, LlamaIndex. • Experience with embeddings, vector search and semantic processing. • Experience with Agent Frameworks (e.g., LangGraph, CrewAI). • Experience working with unstructured data (PDFs, documents, HTML, logs, etc.). • Knowledge of SQL and NoSQL databases and data modeling. • Familiarity with data governance practices (catalog, lineage, security). • Critical thinking, autonomy and the ability to solve complex problems creatively. • Excellent communication, technical influence and sense of responsibility. • **It would be great if you have:** • Experience building internal data platforms (Internal Data Platforms) focused on automation and self-service. • Experience with DataOps practices and data observability. • Knowledge of Infrastructure as Code (e.g., Terraform). • Certifications in Data Engineering, Analytics Engineering or AI Engineering.

🏖️ Benefits

• Profit Sharing/Bonus: Additional recognition to reward your effort and dedication! 💸 • Health and Dental Insurance: To ensure security and care for you and your family. 🏥 • Meal Allowance: Because we know good food is essential for your day! 🍽️ • Life Insurance: Peace of mind and protection for you and your loved ones. 🛡️ • Extended Maternity Leave: 180 days for our mothers to enjoy this special time with their baby! 👶 • Extended Paternity Leave: 20 days so fathers can also be present in the early days of life. 👨‍👩‍👧‍👦 • Fitness Incentive: Access Wellhub (Gympass) and Total Pass to stay active and healthy. 🏋️‍♂️ • Transportation Allowance: To ensure your commute to work is smooth and worry-free. 🚆 • Agreement with SESC: Enjoy great benefits in culture, leisure, health and more! 🎭 • Discount Club: Savings up to 70% on products and services with over 2,000 partners across Brazil and Latin America! 🛍️ • Birthday Day-Off: Celebrate your day with extra rest and fun—you get a day off on your birthday! 🎉 • Pharmacy Discounts: Exclusive discounts on medications to help you save on healthcare! 💊