ml engineer for Legal AI

YPOG is a business law firm providing legal and tax advice, with a strong focus on Legal Tech, Legal AI, and innovation. It develops digital solutions and AI products for the future of legal consulting.

• Design, develop, and operate production-ready Legal AI systems using modern model-independent frameworks and AI best practices;
• Develop Generative AI and LLM applications, including Retrieval-Augmented Generation, Agentic AI, agent and tool-use workflows, and structured information extraction;
• Design data, retrieval, and inference pipelines for complex legal documents and knowledge bases;
• Select and integrate suitable models and providers based on quality, latency, cost, data protection, and operational security;
• Develop robust evaluation and benchmarking frameworks for accuracy, retrieval quality, robustness, and reliability;
• Build and maintain test datasets, automated evaluation pipelines, and meaningful quality metrics;
• Analyze failure patterns and systematically optimize prompts, prompt engineering, chunking, retrieval, ranking, tool use, and system architecture;
• Monitor and continuously improve AI systems in production, including LLMOps;
• Collaborate closely with Legal Engineers, Software Engineers, lawyers, Product, and other interdisciplinary teams;
• Document technical solutions and ensure secure, traceable, and responsible use of AI.

• Practical experience in AI Engineering, Machine Learning Engineering, Applied AI, Data Science with production ownership, or a comparable role;
• Very good Python skills and experience with modern AI, Machine Learning, and Generative AI frameworks and libraries;
• Demonstrated experience building production-ready LLM applications, beyond prompting or prototyping;
• Strong understanding of Retrieval-Augmented Generation, embeddings, semantic search, vector databases, chunking, ranking, and context management;
• Experience with systematic evaluation of generative AI systems, including test datasets, quality metrics, automated tests, and human evaluation;
• Clear, open, and solution-oriented communication in German and English;
• Comfortable working in dynamic environments without rigid processes;
• Ownership of projects and features;
• Cross-functional collaboration skills;
• Pragmatic, results-oriented approach with a focus on working solutions and prioritization;
• Nice to have: Experience with LLMOps, MLOps, tracing, guardrails, red teaming, hallucination assessment, complex document processing including PDF, DOCX, or XML parsing, layout analysis and OCR, Legal Tech, RegTech, or other knowledge-intensive and regulated fields.

• Flexible work in the office or remotely depending on the employee and team;
• Workation within the EU;
• Modern central offices, digital workflows, AI-supported tools, and high-quality IT equipment;
• Professional development program “YBrains” and support for external training;
• Regular feedback and cross-office collaboration;
• Team events, offsites, and company-wide communication formats;
• Urban Sports Club and EGYM Wellpass memberships;
• Unlimited 1:1 access to OpenUp coaching and mindfulness services;
• Yoga, back exercises, running coaching, healthy office snacks, and ergonomic workspaces;
• Deutschlandticket and JobRad leasing option.