AI Platform Engineer

🕒 October 4

🇩🇪 Germany – Remote

⏰ Full Time

🟠 Senior

🏗️ Platform Engineer

🗣️🇩🇪 German Required

Where this job comes from

Posted on DATAGROUP's careers page ↗DATAGROUP's careers page, not through a job board

First seen by Remote Rocketship October 4

Still open on DATAGROUP's site. Checked 7 hours ago.

Apply Now
Logo of DATAGROUP

DATAGROUP

1001 - 5000 employees

Founded 1983

💼 Consulting

📣 Marketing

☁️ SaaS

Consulting • Marketing • SaaS

DATAGROUP is a leading provider of IT outsourcing and consulting services, offering a comprehensive range of solutions including cloud services, application management, and IT security. With a strong focus on customer satisfaction and standardized services, DATAGROUP ensures a seamless IT operation for companies by providing modular and customizable solutions such as the CORBOX. Based in Germany, the company's operations are certified for security and quality, making it a reliable partner for diverse industries, including finance and public sector.

📋 Description

• Develop and operate a sovereign LLM platform, including an OpenAI-compatible gateway, model serving, and GPU infrastructure • Implement customer-specific knowledge integrations (RAG) using vector databases, embeddings, and reranking • Ensure cost control, tenant isolation, data protection, and guardrails • Establish monitoring and observability for the performance, quality, and usage of AI services • Further develop the container-based platform using Docker, Coolify, and Kubernetes • Automate deployments and take ownership of CI/CD processes for in-house developments • Maintain Linux, cloud, and database infrastructure while ensuring stability, security, and availability • Build and enhance monitoring, logging, and alerting solutions • Play an active role in shaping the architecture of platform and AI services • Establish Infrastructure as Code and standardized deployment processes • Ensure data protection-compliant and tenant-isolated operating models • Document solutions, share knowledge across the team, and evaluate new technologies in platform engineering and AI

🎯 Requirements

• Degree in computer science, business informatics, or a comparable qualification • Several years of experience in DevOps, platform engineering, or cloud/infrastructure environments • Extensive hands-on experience operating container-based applications and modern platforms • Experience building and running LLM and AI services in production, ideally in self-hosted environments • Very good knowledge of Kubernetes, Docker, and Linux • Experience with CI/CD pipelines, cloud platforms—particularly Azure—and PostgreSQL • Practical experience with LLM gateways, RAG architectures, vector databases, and model-serving solutions • Solid Python skills for automation and integrations • Independent and structured working style, a high degree of ownership, and strong awareness of security and data protection • Strong architectural and platform expertise

🏖️ Benefits

• Open and collaborative company culture and a trusting working environment • Comprehensive onboarding with support from the entire AIS team • Flat hierarchies, short decision-making processes, and a high degree of autonomy • Strategic role with significant influence on the future platform landscape • Opportunity to work on sovereign LLM hosting and AI infrastructure • Modern infrastructure featuring Kubernetes, Docker, CI/CD, and cloud technologies • Opportunity to actively shape standards, processes, and architectural decisions • Individual professional development budget for conferences, certifications, and specialized training • Clear career and development paths • Opportunity to specialize as an AI Platform Engineer or LLMOps expert • Small, focused, and agile team with short decision-making processes • Open feedback culture with regular one-to-one meetings and retrospectives

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 September 21

Contabo

201 - 500

☁️ SaaS

Senior Platform & Reliability Engineer owning shared infrastructure, observability, and reliability processes. Strengthening Contabo’s cloud hosting platform used by customers in over 190 countries.

🕒 September 17

Recare

51 - 200

🏥 Healthcare

⚕️ Healthcare Insurance

☁️ SaaS

Senior platform engineer operating AWS, Kubernetes, and SageMaker AI infrastructure for Recare, a German healthcare SaaS company. Ensuring reliable, scalable production workloads in regulated healthcare.

🕒 September 16

Mondo

51 - 200

💼 Consulting

📣 Marketing

📦 Logistics

Platform Engineer securing Mondoo’s cloud infrastructure and policy-as-code platform. Automating controls across Kubernetes, AWS, Azure, GCP, and on-premises environments.

🕒 September 3

evoila

201 - 500

💼 Consulting

Senior Kubernetes Platform Engineer consulting on enterprise Kubernetes and cloud-native platforms for evoila Germany GmbH. Designing, implementing, and modernizing scalable DevOps environments.

🗣️🇩🇪 German Required

🕒 August 18

Synera

51 - 200

🤖 Artificial Intelligence

Senior Platform Engineer transforming Synera’s AI Agent Platform from a desktop app into an operable on-prem server product. Building Docker, CI/CD, deployment, and AI-agent tooling.

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok