ai engineer

CreateFuture is an AI-native consulting partner that works alongside organisations to build digital products and services, develop AI solutions, and create supporting practices. Its team collaborates with clients across delivery, software development, go-to-market strategy, and AI engineering.

• Design and build evaluation and observability pipelines using platforms such as Braintrust, LangSmith, Arize, or Weights & Biases;
• Curate golden datasets and design LLM-as-judge and human-in-the-loop scoring pipelines;
• Build production observability for AI features, including token-level tracing, quality signal monitoring, hallucination and refusal detection, and cost attribution per use case;
• Wire evaluation gates into CI/CD promotion paths so quality checks are enforced before release;
• Turn evaluation and observability data into actionable decisions for engineering and product teams;
• Work with engineering and product teams to interpret scores and distinguish meaningful results from noise.

• Strong Python skills and hands-on AI engineering experience, particularly with evaluations and observability;
• Production experience with Braintrust, LangSmith, Arize, Weights & Biases, or a similar platform;
• Ability to design scoring pipelines and sanity-check whether a score is meaningful;
• Sufficient CI/CD experience to integrate evaluation gates into a promotion pipeline;
• Ability to communicate data insights clearly enough for engineering and product teams to act on them.

• 35 Days of leave, including bank holidays;
• Private medical insurance;
• Enhanced parental and adoption leave;
• Financial coaching and a 5% pension match;
• 40 Hours of paid learning and development;
• Flexible working with hybrid and remote options;
• Office hubs in Edinburgh, Leeds, Manchester, London, and Bulgaria;
• Occasional travel to client sites or CreateFuture offices when needed;
• The hiring process may include a short presentation, practical or technical task, or values-focused conversation.