AI Platform Engineer

🕒 September 3

🇩🇪 Germany – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🏗️ Platform Engineer

👻 Ghost score 19%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

DATAGROUP

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 1983

💼 Consulting

📣 Marketing

☁️ SaaS

Consulting • Marketing • SaaS

DATAGROUP is a leading provider of IT outsourcing and consulting services, offering a comprehensive range of solutions including cloud services, application management, and IT security. With a strong focus on customer satisfaction and standardized services, DATAGROUP ensures a seamless IT operation for companies by providing modular and customizable solutions such as the CORBOX. Based in Germany, the company's operations are certified for security and quality, making it a reliable partner for diverse industries, including finance and public sector.

📋 Description

• Develop and operate a sovereign LLM platform, including an OpenAI-compatible gateway, model serving, and GPU infrastructure • Implement customer-specific knowledge integrations (RAG) using vector databases, embeddings, and reranking • Ensure cost control, tenant isolation, data protection, and guardrails • Establish monitoring and observability for the performance, quality, and usage of AI services • Further develop the container-based platform using Docker, Coolify, and Kubernetes • Automate deployments and take ownership of CI/CD processes • Manage Linux, cloud, and database infrastructure while ensuring stability, security, and availability • Build and enhance monitoring, logging, and alerting solutions • Actively shape the architecture of platform and AI services • Establish Infrastructure as Code and standardized deployment processes • Ensure data protection-compliant and tenant-secure operating models • Document solutions, share knowledge across the team, and evaluate new technologies in platform engineering and AI

🎯 Requirements

• Degree in Computer Science, Business Informatics, or a comparable qualification • Several years of experience in DevOps, platform engineering, or cloud/infrastructure environments • Strong hands-on experience operating container-based applications and modern platforms • Experience building and running LLM and AI services in production, ideally in self-hosted environments • Advanced knowledge of Kubernetes, Docker, and Linux • Experience with CI/CD pipelines, cloud platforms—particularly Azure—and PostgreSQL • Practical experience with LLM gateways, RAG architectures, vector databases, and model-serving solutions • Solid Python skills for automation and integrations • Independent and structured working style, with a high degree of ownership and strong awareness of security and data protection • Strong understanding of architecture and platform engineering

🏖️ Benefits

• Open and collaborative company culture • Trust-based working environment • Comprehensive onboarding with support from the entire AIS team • Flat hierarchies, short decision-making processes, and a high degree of freedom to shape your work • Strategic role with significant influence over the future platform landscape • Opportunity to work on sovereign LLM hosting and AI infrastructure • Modern infrastructure featuring Kubernetes, Docker, CI/CD, and cloud technologies • Opportunity to actively shape standards, processes, and architectural decisions • Individual professional development budget for conferences, certifications, and specialist training • Clear career and development paths • Opportunity to specialize as an AI Platform Engineer or LLMOps expert • Small, focused, and agile team • Open feedback culture with regular one-on-one meetings and retrospectives