описание
Most enterprise AI rollouts rely on public cloud APIs that heavily regulated organisations cannot touch. This London-based infrastructure company builds sovereign runtime environments that allow defence, intelligence, and regulated enterprise teams to deploy frontier and open-weight models entirely inside their own perimeters, including air-gapped clusters. Backed by over $70M from tier-one global investors and led by alumni from top-tier enterprise software and defence engineering, they are tackling the foundational reliability problem of sovereign AI.
задачи
- Architect and automate zero-downtime deployment pipelines for LLM services and autonomous agent workflows on Kubernetes, using canary and blue/green rollout strategies.
- Build the end-to-end evaluation and observability framework to trace non-deterministic agent execution paths, monitor hallucination rates, and detect model drift.
- Own GPU and CPU allocation, cluster autoscaling, and compute efficiency to drive down time-to-first-token while controlling infrastructure expenditure.
- Maintain the stability and latency of critical data subsystems, including real-time vector indexing, embedding pipelines, and feature stores.
- Diagnose complex production failure modes that span agent runtime logic, orchestration frameworks, and underlying cloud infrastructure.
требования
- 3+ years in MLOps, LLMOps, or AI platform engineering, with proven experience running containerised workloads on Kubernetes at production scale.
- Strong Python engineering ability paired with practical fluency in Infrastructure as Code and modern CI/CD automation.
- Hands-on experience instrumenting observability and LLM tracing across distributed systems using tools like OpenTelemetry, Prometheus, Grafana, LangSmith, Langfuse, or Arize.
- Operational familiarity with agentic architectures, including state persistence, tool execution boundaries, and failure handling across multi-step agent runs.
условия
- Условий в вакансии нет
навыки
компания
С 2006 года разрабатывает мобильные приложения и web-сервисы для среднего и крупного бизнеса. Среди наших клиентов — Сбербанк, Газпром, Nokia, ВТБ, МТС, «Циан», ПИК, Сколково и многие другие
Подробнее о компании →