AI engineer for inference APIs

Help ensure the Bundeswehr's digital future readiness together with us.

• Design, development and operation of a central AI platform
• Integration, provision and optimization of AI models via standardized inference APIs
• Selection, evaluation and benchmarking of AI models, taking application requirements into account
• Ensuring the scalability, security, reliability and performance of inference APIs under load (e.g. caching, rate limiting)
• Providing functionalities and tools for chatbots and agents via MCP, A2A and AG-UI
• Implementing and integrating LLM-based agents using common Python frameworks (e.g. LangGraph, CrewAI, PydanticAI)
• Collaborating with MLOps engineers on integrating AI models and services into our infrastructure (e.g. GPU clusters, Kubernetes)
• Documentation and support for internal and external developers

• Completed master's degree in computer science, mathematics or a comparable field
• At least 5 years of relevant professional experience after completing your degree is mandatory
• Experience evaluating, deploying and operating AI models in production
• Experience in prompt, context and tool engineering for generative AI models
• Experience in backend development with Python, Go, Rust or Java
• Experience with on-premises cloud technologies (e.g. Kubernetes) and MLOps frameworks (MLflow, Kubeflow)
• Expertise in performance optimization and monitoring (e.g. Prometheus, Grafana)
• Ability to independently develop and evaluate technical concepts and advocate for them with technical and non-technical stakeholders
• Fluent German and very good spoken and written English
• Будет плюсом: Experience developing, fine-tuning and training AI models is an advantage

• Through varied and socially relevant tasks, we ensure the smooth operation of IT and the digitalization of the Bundeswehr
• We are united by our goal. A respectful approach to one another and strong team spirit are essential to us
• We offer 30 days of annual leave, one traditional holiday day, plus options for individual adjustments
• Our benefits app provides a monthly allowance, and you can also get tax benefits on public transport tickets
• We enable flexibility to balance work and private life, for example through mobile working or trust-based working hours
• We support professional and personal development through individual measures and free access to LinkedIn Learning
• Our JobRad offer lets you lease up to 2 bicycles
• The starting salary is generally between EUR 87,700 and EUR 113,150 gross per year. The exact amount is determined based on criteria such as qualifications, scope of responsibility and the requirements of the position. Justified deviations may be possible in individual cases.