Search Remote Jobs

AI Platform Engineer

🕒 August 4

🇩🇪 Germany – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🏗️ Platform Engineer

👻 Ghost score 20%

infoinfo

🗣️🇩🇪 German Required

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of DATAGROUP

DATAGROUP

1001 - 5000 employees

Founded 1983

💼 Consulting

📣 Marketing

☁️ SaaS

Consulting • Marketing • SaaS

DATAGROUP is a leading provider of IT outsourcing and consulting services, offering a comprehensive range of solutions including cloud services, application management, and IT security. With a strong focus on customer satisfaction and standardized services, DATAGROUP ensures a seamless IT operation for companies by providing modular and customizable solutions such as the CORBOX. Based in Germany, the company's operations are certified for security and quality, making it a reliable partner for diverse industries, including finance and public sector.

📋 Description

• Develop and operate a sovereign LLM platform, including an OpenAI-compatible gateway, model serving, and GPU infrastructure • Implement customer-specific knowledge integrations (RAG) with vector databases, embeddings, and re-ranking • Ensure cost control, tenant isolation, data protection, and guardrails • Establish monitoring and observability for performance, quality, and usage of AI services • Further develop the container-based platform built on Docker, Coolify, and Kubernetes • Automate deployments and take ownership of CI/CD processes • Manage Linux, cloud, and database infrastructure and ensure stability, security, and availability • Build and enhance monitoring, logging, and alerting solutions • Actively shape the architecture of platform and AI services • Establish Infrastructure as Code and standardized deployment processes • Ensure privacy-compliant and tenant-secure operating models • Document solutions, enable knowledge transfer within the team, and evaluate new technologies in platform engineering and AI

🎯 Requirements

• Degree in (business) computer science or a comparable qualification • Several years of experience in DevOps, platform engineering, or cloud/infrastructure roles • Solid hands-on experience operating container-based applications and modern platforms • Experience building and running LLM and AI services in production, ideally in self-hosted environments • Very good knowledge of Kubernetes, Docker, and Linux • Experience with CI/CD pipelines, cloud platforms (especially Azure), and PostgreSQL • Practical experience with LLM gateways, RAG architectures, vector databases, and model-serving solutions • Strong Python skills for automation and integrations • Independent and structured working style with high personal responsibility and a strong security and data-protection mindset • Strong architecture and platform understanding

🏖️ Benefits

• Open and cooperative company culture • Trust-based working atmosphere • Comprehensive onboarding with support from the entire AIS team • Flat hierarchies, short decision-making paths, and a high degree of freedom to shape your role • Strategic position with significant influence on the future platform landscape • Modern infrastructure with Kubernetes, Docker, CI/CD, and cloud technologies • Individual training budget for conferences, certifications, and specialist courses • Clear career and development paths • Opportunity to specialize as an AI Platform Engineer or LLMOps expert • Small, focused, and agile team • Open feedback culture with regular 1:1s and retrospectives

Apply Now

Similar Jobs

🕒 July 31

SAP Fioneer

501 - 1000

💼 Consulting

🛡️ Insurance

📦 Logistics

AI Platform Engineer building secure, scalable cloud infrastructure for SAP Fioneer's banking AI initiative. Operating Kubernetes, CI/CD, observability, and multi-tenant platforms for production AI applications.

🇩🇪 Germany – Remote

⏰ Full Time

🟢 Junior

🟡 Mid-level

🏗️ Platform Engineer

🕒 July 28

Qdrant

51 - 200

🤖 Artificial Intelligence

☁️ SaaS

Senior Software Engineer building Qdrant’s Go-based cloud platform for open-source AI vector search. Designing distributed systems, control-plane services, and internal APIs for managed cloud deployments.

🕒 July 18

SHOP APOTHEKE EUROPE

1001 - 5000

🏥 Healthcare

⚕️ Healthcare Insurance

🛒 Retail

Join Redcare Pharmacy as a Senior Platform Engineer to shape their next-generation AI Platform using modern cloud-native technologies. Work in a dynamic team to deliver reliable AI systems.

🕒 July 14

Famedly GmbH

11 - 50

🏥 Healthcare

💼 Consulting

📦 Logistics

Platform Engineer managing Kubernetes platform and GitOps workflows at healthcare startup. Famedly digitizes secure communication in healthcare systems.

🇩🇪 Germany – Remote

💵 €60k - €70k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🏗️ Platform Engineer

🗣️🇩🇪 German Required

🕒 June 29

zollsoft GmbH

201 - 500

🏥 Healthcare

💼 Consulting

⚕️ Healthcare Insurance

DevOps/Platform Engineer enhancing deployment processes and IT infrastructure in a fully remote setup. Working with modern technologies and a team-driven culture at zollsoft.

🇩🇪 Germany – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🏗️ Platform Engineer

🗣️🇩🇪 German Required