Senior AI Platform Engineer – LLMs & Agents

🕒 October 23

🇩🇪 Germany – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🏗️ Platform Engineer

🗣️🇩🇪 German Required

Where this job comes from

Posted on Neurawork's careers page ↗Neurawork's careers page, not through a job board

First seen by Remote Rocketship October 23

Still open on Neurawork's site. Checked 3 hours ago.

Apply Now
Logo of Neurawork

Neurawork

1 - 10 employees

Founded 2023

🤖 Artificial Intelligence

Artificial Intelligence

Neurawork is an innovative company dedicated to optimizing neural networks for various applications. Their cutting-edge technology enhances the efficiency and performance of AI models. Neurawork is committed to driving advancements in artificial intelligence.

📋 Description

• Own the agent architecture and core AI platform • Build a production-ready AI agent platform based on PydanticAI, LiteLLM, and Langfuse • Develop RAG pipelines with pgvector at scale, including multi-tenant isolation, index rebuild strategies, hybrid search, and re-ranking • Build a multi-tenant token quota service and tenant-specific evaluation frameworks • Integrate MCP tools as a core part of the architecture • Ensure end-to-end auditability from prompt to output • Make architectural decisions for banking, insurance, and pharmaceutical clients • Document relevant architectural decisions in ADRs • Provide visibility into LLM calls, costs, and latency in Langfuse • Report to Christoph Knöll (Founder/CEO) and work closely with the Head of AI • Describe an LLM or RAG system you have brought into production as part of the application process

🎯 Requirements

• 5+ years of production software engineering experience with Python • Experience with LLMs in production, including tokens, latency, costs, and evaluations • Hands-on experience building and operating RAG systems, including retrieval tuning and re-ranking • Experience using an agent framework such as LangGraph, PydanticAI, or a comparable framework in production • Excellent German and good English skills • Experience sizing pgvector for large-scale data volumes • Foundational knowledge of Kubernetes • Experience with regulatory requirements such as the EU AI Act, DORA, BaFin/MaRisk, or GxP • Experience with LiteLLM, Langfuse, or MCP is a plus but not required • Based in Germany

🏖️ Benefits

• Permanent employment contract • 40 hours per week • 28 days of annual leave • Fully remote, with residence in Germany • Flexible working hours • Team days at the Munich office approximately once a month • Modern technology stack and dedicated time to evaluate new models, frameworks, and retrieval approaches • Conferences and training • Opportunities to represent the company externally as an expert, for example through talks or technical articles

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 October 12

Shopware

201 - 500

💼 Consulting

📣 Marketing

📦 Logistics

Principal Platform Engineer für Shopwares Open-Source-E-Commerce-Plattform. Aufbau und Betrieb einer AWS-basierten Data Platform mit CDC, Lakehouse, Orchestrierung und Governance.

🗣️🇩🇪 German Required

🕒 October 4

DATAGROUP

1001 - 5000

💼 Consulting

📣 Marketing

☁️ SaaS

AI Platform Engineer building and operating sovereign LLM platforms, RAG systems, and cloud infrastructure. Shaping AI architecture and CI/CD for German IT services provider DATAGROUP.

🗣️🇩🇪 German Required

🕒 September 21

Contabo

201 - 500

☁️ SaaS

Senior Platform & Reliability Engineer owning shared infrastructure, observability, and reliability processes. Strengthening Contabo’s cloud hosting platform used by customers in over 190 countries.

🕒 September 17

Recare

51 - 200

🏥 Healthcare

⚕️ Healthcare Insurance

☁️ SaaS

Senior platform engineer operating AWS, Kubernetes, and SageMaker AI infrastructure for Recare, a German healthcare SaaS company. Ensuring reliable, scalable production workloads in regulated healthcare.

🕒 September 16

Mondo

51 - 200

💼 Consulting

📣 Marketing

📦 Logistics

Platform Engineer securing Mondoo’s cloud infrastructure and policy-as-code platform. Automating controls across Kubernetes, AWS, Azure, GCP, and on-premises environments.

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok