Senior AI Platform Engineer – LLMs & Agents

🔥 1 minute ago

🇩🇪 Germany – Remote

⏰ Full Time

🟠 Senior

🏗️ Platform Engineer

🗣️🇩🇪 German Required

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Neurawork

Neurawork

1 - 10 employees

Founded 2023

🤖 Artificial Intelligence

Artificial Intelligence

Neurawork is an innovative company dedicated to optimizing neural networks for various applications. Their cutting-edge technology enhances the efficiency and performance of AI models. Neurawork is committed to driving advancements in artificial intelligence.

📋 Description

• Own the agent architecture and core AI platform • Build a production-ready AI agent platform based on PydanticAI, LiteLLM, and Langfuse • Develop RAG pipelines with pgvector at scale, including multi-tenant isolation, index rebuild strategies, hybrid search, and re-ranking • Build a multi-tenant token quota service and tenant-specific evaluation frameworks • Integrate MCP tools as a core part of the architecture • Ensure end-to-end auditability from prompt to output • Make architectural decisions for banking, insurance, and pharmaceutical clients • Document relevant architectural decisions in ADRs • Provide visibility into LLM calls, costs, and latency in Langfuse • Report to Christoph Knöll (Founder/CEO) and work closely with the Head of AI • Describe an LLM or RAG system you have brought into production as part of the application process

🎯 Requirements

• 5+ years of production software engineering experience with Python • Experience with LLMs in production, including tokens, latency, costs, and evaluations • Hands-on experience building and operating RAG systems, including retrieval tuning and re-ranking • Experience using an agent framework such as LangGraph, PydanticAI, or a comparable framework in production • Excellent German and good English skills • Experience sizing pgvector for large-scale data volumes • Foundational knowledge of Kubernetes • Experience with regulatory requirements such as the EU AI Act, DORA, BaFin/MaRisk, or GxP • Experience with LiteLLM, Langfuse, or MCP is a plus but not required • Based in Germany

🏖️ Benefits

• Permanent employment contract • 40 hours per week • 28 days of annual leave • Fully remote, with residence in Germany • Flexible working hours • Team days at the Munich office approximately once a month • Modern technology stack and dedicated time to evaluate new models, frameworks, and retrieval approaches • Conferences and training • Opportunities to represent the company externally as an expert, for example through talks or technical articles

Apply Now

Similar Jobs

🕒 3 days ago

WBS

201 - 500

💼 Consulting

⚡ Energy

Power Platform Entwickler:in entwickelt KI-gestützte Low-Code-Lösungen für die WBS GRUPPE. Automatisierung von Prozessen, Copilots, Governance und Citizen-Developer-Community.

🗣️🇩🇪 German Required

🕒 October 15

CPU Softwarehouse AG

51 - 200

💼 Consulting

📣 Marketing

📦 Logistics

Platform Engineer operating and automating self-managed GitLab platforms for a German banking IT services provider. Supporting CI/CD, Kubernetes, and internal developer platform services.

🗣️🇩🇪 German Required

🕒 October 15

SHOP APOTHEKE EUROPE

1001 - 5000

🏥 Healthcare

⚕️ Healthcare Insurance

🛒 Retail

Senior Platform Engineer building secure Azure infrastructure and agentic AI platforms. Enabling Redcare Pharmacy’s teams to deploy and operate AI workloads reliably.

🕒 October 14

SHOP APOTHEKE EUROPE

1001 - 5000

🏥 Healthcare

⚕️ Healthcare Insurance

🛒 Retail

Senior Platform Engineer building secure Azure infrastructure and agentic AI platforms. Enabling Redcare Pharmacy’s e-pharmacy teams to deploy and operate AI agents reliably.

🕒 October 13

Maesn

11 - 50

💼 Consulting

📦 Logistics

🔌 API

Senior Backend Engineer owning Azure infrastructure, observability, security, and reliability for Maesn’s B2B SaaS integration platform. Building backend features and mentoring the engineering team.