platform engineer

The Cornelsen Group is a leading provider in the German-speaking education market, offering innovative cross-media educational solutions for all stages of life. The organization focuses on creating meaningful educational content with high social relevance.

• Operate and continuously develop the LiteLLM-based LLM proxy to provide product teams with reliable access to LLM providers like Azure OpenAI and AWS Bedrock;
• Manage the gateway as a production-critical service by defining SLOs, provider failover, and rate-limiting;
• Lead incident response for the gateway service;
• Ensure data protection compliance, including GDPR-compliant routing, EU data residency, and adherence to the EU AI Act;
• Advise product teams on model selection, integration patterns, and prompt strategies;
• Create clear developer documentation and best-practice examples;
• Support teams with onboarding and daily platform usage;
• Act as the primary point of contact for product teams working with LLMs;
• Establish centralized observability for LLM and agent applications using tools like Langfuse.

• Practical experience in operating an LLM proxy or gateway in production, preferably with LiteLLM;
• Solid Kubernetes knowledge and familiarity with at least one cloud platform (Azure, AWS, or GCP);
• Experience with model providers such as Azure OpenAI or AWS Bedrock;
• Strong consulting mindset with the ability to influence others without formal authority;
• Ability to communicate technical trade-offs clearly to product teams and non-technical stakeholders;
• Excellent documentation and knowledge-sharing skills;
• Experience with observability tooling, ideally Langfuse or similar stacks;
• Fluent in German and English;
• Nice to have: Experience in educational technology or similar regulated domains.

• 30 Days of vacation and flexible working hours;
• Up to 3 days of mobile work per week;
• Up to 20 days of workation in Europe (EEA) per year;
• Access to health and well-being offers via evermood and Wellhub;
• Childcare subsidies, book discounts, company pension scheme, and capital-forming benefits;
• Sustainable mobility options including company bike leasing and reduced Deutschlandticket;
• On-site canteen with organic, regional food;
• Professional development opportunities including training, conferences, and e-learning;
• Regular team events and sports activities.