machine learning engineer

Toloka creates data that powers leading GenAI models and innovations by combining experts, crowd, and a tech platform to teach AI models to reason and evaluate their efficacy and safety.

• Train, fine-tune, and distill ML models including RL approaches to power autonomous AI agents;
• Build and operate agentic workflows in Python, handling complex reasoning and hybrid human-expert interactions;
• Own evaluation and benchmarking, selecting foundational models and establishing cost models;
• Manage the full ML lifecycle by designing solutions, shipping to production, and monitoring real-time signals;
• Implement observability metrics tailored for agent logic, model performance, and system reliability.

• 3+ Years of experience in ML with a strong background in model training, fine-tuning, and Reinforcement Learning;
• 1+ Year in Agent Development with practical experience building, evaluating, and launching autonomous AI agents;
• Proven experience working with agentic frameworks such as LangChain, LlamaIndex, or AutoGen;
• Practical knowledge of model distillation and adapting open-source models like Llama and Mistral;
• Advanced proficiency in Python with a drive to apply disciplined software engineering standards to ML;
• Ability to work across the entire chain from research to production operations;
• Fluency in English at B2 level or above.

• Competitive compensation package including base salary, bonus, and ESOP;
• Paid PTO and benefits varying depending on location;
• Full remote or hybrid model if based in the Netherlands or Serbia;
• IT setup and home office allowances.