AI Platform Engineer

🕒 September 3

🇩🇪 Germany – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🏗️ Platform Engineer

🗣️🇩🇪 German Required

Where this job comes from

Posted on DATAGROUP's careers page ↗DATAGROUP's careers page, not through a job board

First seen by Remote Rocketship September 3

Still open on DATAGROUP's site. Checked 4 hours ago.

Apply Now
Logo of DATAGROUP

DATAGROUP

1001 - 5000 employees

Founded 1983

💼 Consulting

📣 Marketing

☁️ SaaS

Consulting • Marketing • SaaS

DATAGROUP is a leading provider of IT outsourcing and consulting services, offering a comprehensive range of solutions including cloud services, application management, and IT security. With a strong focus on customer satisfaction and standardized services, DATAGROUP ensures a seamless IT operation for companies by providing modular and customizable solutions such as the CORBOX. Based in Germany, the company's operations are certified for security and quality, making it a reliable partner for diverse industries, including finance and public sector.

📋 Description

• Develop and operate a sovereign LLM platform, including an OpenAI-compatible gateway, model serving, and GPU infrastructure • Implement customer-specific knowledge integrations (RAG) using vector databases, embeddings, and reranking • Ensure cost control, tenant isolation, data protection, and guardrails • Establish monitoring and observability for the performance, quality, and usage of AI services • Further develop the container-based platform using Docker, Coolify, and Kubernetes • Automate deployments and take ownership of CI/CD processes • Manage Linux, cloud, and database infrastructure while ensuring stability, security, and availability • Build and enhance monitoring, logging, and alerting solutions • Actively shape the architecture of platform and AI services • Establish Infrastructure as Code and standardized deployment processes • Ensure data protection-compliant and tenant-secure operating models • Document solutions, share knowledge across the team, and evaluate new technologies in platform engineering and AI

🎯 Requirements

• Degree in Computer Science, Business Informatics, or a comparable qualification • Several years of experience in DevOps, platform engineering, or cloud/infrastructure environments • Strong hands-on experience operating container-based applications and modern platforms • Experience building and running LLM and AI services in production, ideally in self-hosted environments • Advanced knowledge of Kubernetes, Docker, and Linux • Experience with CI/CD pipelines, cloud platforms—particularly Azure—and PostgreSQL • Practical experience with LLM gateways, RAG architectures, vector databases, and model-serving solutions • Solid Python skills for automation and integrations • Independent and structured working style, with a high degree of ownership and strong awareness of security and data protection • Strong understanding of architecture and platform engineering

🏖️ Benefits

• Open and collaborative company culture • Trust-based working environment • Comprehensive onboarding with support from the entire AIS team • Flat hierarchies, short decision-making processes, and a high degree of freedom to shape your work • Strategic role with significant influence over the future platform landscape • Opportunity to work on sovereign LLM hosting and AI infrastructure • Modern infrastructure featuring Kubernetes, Docker, CI/CD, and cloud technologies • Opportunity to actively shape standards, processes, and architectural decisions • Individual professional development budget for conferences, certifications, and specialist training • Clear career and development paths • Opportunity to specialize as an AI Platform Engineer or LLMOps expert • Small, focused, and agile team • Open feedback culture with regular one-on-one meetings and retrospectives

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 September 3

evoila

201 - 500

💼 Consulting

Senior Kubernetes Platform Engineer consulting on enterprise Kubernetes and cloud-native platforms for evoila Germany GmbH. Designing, implementing, and modernizing scalable DevOps environments.

🗣️🇩🇪 German Required

🕒 August 18

Synera

51 - 200

🤖 Artificial Intelligence

Senior Platform Engineer transforming Synera’s AI Agent Platform from a desktop app into an operable on-prem server product. Building Docker, CI/CD, deployment, and AI-agent tooling.

🕒 August 7

Shine

201 - 500

💳 Fintech

🏦 Banking

☁️ SaaS

Staff Platform Engineer securing Azure infrastructure for Shine, a European fintech serving small businesses. Defining cloud controls, hardening identity, and enabling secure multi-cloud platform operations.

🕒 August 6

Polarise

11 - 50

💼 Consulting

📦 Logistics

🤖 Artificial Intelligence

Platform Engineer developing cloud-native platforms and scalable APIs for Polarise, a European sovereign AI infrastructure company. Automating infrastructure, CI/CD, observability, security, and developer self-service.

🕒 July 14

Famedly GmbH

11 - 50

🏥 Healthcare

💼 Consulting

📦 Logistics

Platform Engineer managing Kubernetes platform and GitOps workflows at healthcare startup. Famedly digitizes secure communication in healthcare systems.

🗣️🇩🇪 German Required

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok