Senior Data Engineer – Generative AI, Data and MDM

🕒 vor 8 Tagen

Jetzt Bewerben

Ähnliche Remote-Jobs finden

E-Mails für Remote-Jobs erhalten

📊 Überprüfen Sie Ihre Lebenslauf-Bewertung für diese Stelle

Verbessern Sie Ihre Chancen auf ein Vorstellungsgespräch, indem Sie Ihre Lebenslauf-Bewertung vor der Bewerbung überprüfen.

Lebenslauf hochladen

CI&T

WebsiteLinkedInAlle Stellen

5001 - 10000 Mitarbeiter

Gegründet 1995

🤖 Künstliche Intelligenz

☁️ SaaS

💰 €5.500.000 Venture Round im 2014-04

Artificial Intelligence • Cloud Services • SaaS

CI&T ist ein globaler Spezialist für Technologietransformationen, der sich darauf konzentriert, Organisationen bei ihrer technologischen Weiterentwicklung zu unterstützen. Mit Dienstleistungen, die von der Modernisierung von Anwendungen und Cloud-Lösungen bis hin zu KI-gesteuerter Datenanalyse und Kundenerfahrungen reichen, befähigt CI&T Unternehmen, ihr Wachstum zu beschleunigen und die betriebliche Effizienz zu maximieren. Das Unternehmen legt großen Wert auf digitales Produktdesign, Strategieberatung und immersive Erlebnisse und sorgt für ein robustes Unterstützungssystem für Unternehmen in verschiedenen Branchen.

Beschreibung

• Develop, optimize and maintain scalable data pipelines using Databricks, Spark and PySpark. • Work on integration, transformation, cleansing and provisioning of large-scale master/customer data. • Build and maintain cloud-based Big Data products, ensuring scalability, performance, reliability and data quality. • Work with customer master data domain, supporting initiatives related to Golden Record, data quality, governance and MDM. • Design and implement data solutions that support intelligent systems based on Generative AI, agents and multi-agent systems. • Prepare, structure and provision data for consumption by Machine Learning models, LLMs, autonomous agents and intelligent workflows. • Support the construction of agents and multi-agent systems capable of analyzing customer master data at scale. • Help identify patterns, inconsistencies, gaps, duplicates, anomalies and opportunities for improvement in master/customer data. • Develop data mechanisms for generating alerts, explainable recommendations and decision support. • Apply Analytics and Machine Learning techniques for anomaly detection, classification, clustering and scoring of master/customer data. • Support strategies for data qualification, enrichment, prioritization and governance. • Use Generative AI to support the generation, evolution, validation and explanation of business rules. • Explore and support implementation of architectures such as RAG, autonomous agents, multi-agent systems and intelligent workflows. • Work with near real-time data processing using Kafka. • Support the productionization of Machine Learning models on Databricks, applying MLOps concepts. • Create, maintain and evolve CI/CD pipelines using GitHub and GitHub Actions. • Ensure development best practices, ensuring solutions follow standards of quality, efficiency, maintainability and governance. • Optimize the use of available data to maximize its value for business and technology areas. • Collaborate with MDM, Data, Technology and Business teams to ensure developed solutions are measurable, governable and applicable. • Support technical and functional refinements, ensuring clarity, feasibility and alignment of stories to project needs. • Help create clear, well-defined and technically feasible user stories. • Participate in AS-IS and TO-BE design, documenting current and future processes, identifying technical debt, risks and opportunities for improvement. • Develop refined and approved stories, ensuring quality, efficiency and adherence to technical standards. • Identify technical debt and propose continuous improvements in architecture, processes, data and solutions. • Work in partnership with data and business focal points to ensure alignment between technical solutions, best practices and strategic needs.

🎯 Anforderungen

• Strong experience as a Data Engineer, Senior Data Engineer or equivalent role. • Strong proficiency in Python for data engineering, automation, data analysis and supporting AI solutions. • Solid knowledge of SQL and exploration of structured data. • Experience with Databricks, PySpark and Spark. • Experience building, optimizing and maintaining scalable data pipelines. • Experience in cloud environments, preferably Azure Databricks and GCP. • Knowledge or experience with Gemini to support GenAI solutions. • Knowledge of Generative AI, LLMs and data-driven intelligent applications. • Knowledge of agent architectures, multi-agent systems and autonomous systems. • Experience with RAG, intelligent workflows, data-driven recommendation and cognitive automation. • Experience with applied Machine Learning techniques, including anomaly detection, classification, clustering and scoring. • Experience with near real-time data processing, preferably with Kafka. • Experience with productionizing Machine Learning models on Databricks and MLOps practices. • Experience with CI/CD pipelines, especially GitHub and GitHub Actions. • Mastery of data engineering best practices, versioning, testing, code review and data quality. • Knowledge of programming logic, application development and performance optimization. • Ability to translate business problems into data, analytical and intelligent solutions. • Experience working in agile squads and agile methodologies.

🏖️ Vorteile

• Health and dental insurance; • Meal and grocery allowances; • Childcare assistance; • Extended parental leave; • Partnership with gyms and health & wellness professionals via Wellhub (Gympass) TotalPass; • Profit Sharing (PLR); • Life insurance; • Continuous learning platform (CI&T University); • Discount club; • Free online platform dedicated to physical and mental health and wellbeing; • Pregnancy and responsible parenting course; • Partnerships with online course platforms; • Language learning platform; • And many others