anti-fraud engineer

At Toloka AI we create data that powers leading GenAI models and innovations. We work with frontier labs, big tech, renowned AI startups, enterprises and non-profit research organizations worldwide. Our team builds the systems that detect and stop fraud on the Toloka platform. Fraud here is a moving target: bad actors adapt quickly, test our defenses, and increasingly use automation and LLMs to get around them.

• Explore data to find new fraud patterns, anomalies, and insights, and to understand how fraudsters operate.
• Design metrics that show how our protection works, and build dashboards and charts that make them visible.
• Generate hypotheses from data and test them rigorously.
• Turn validated hypotheses into production solutions: rules and heuristics, ML models, and LLM-based approaches.
• Build and maintain data pipelines (SQL, Python, Airflow) that keep our defenses running and up to date.
• Think like an attacker. Anticipate how a new defense could be bypassed, and design it to hold up from day one.
• Own your area end to end: from the first insight to a deployed solution and its ongoing monitoring.
• Help shape anti-fraud rules and policies, including how we define and classify fraud.

• You can frame a vague problem, choose the right metrics, and draw sound conclusions from messy data.
• You generate ideas from data and know how to test them properly.
• You write confident, efficient queries on large datasets.
• You can build features, train and evaluate models, and ship them to production.
• You have working experience with Airflow or similar orchestration tools.
• You understand the trade-offs of protection: false positives, impact on honest users, and cost.
• Будет плюсом: ClickHouse experience is a plus; Practical experience with LLMs is a plus; Hands-on experience in anti-fraud, trust & safety, risk, or abuse prevention (a big plus); Experience with anomaly detection, graph analysis, or behavioral modeling; Experience applying LLMs to analytical or classification tasks; Experience with Databricks; Experience with crowdsourcing or data annotation platforms

• You will be part of an international, dynamic environment that drives innovation and sets new standards in the AI and technology sector.
• Competitive compensation package including base salary, bonus, and ESOP.
• Flexibility: we offer remote or hybrid employment. You will also design with your manager a workday that works best for you;
• Paid PTO and benefits will vary depending on location.
• IT setup and home office allowances.
• Personal and career development: we support employee’s ambition for professional development and encourage them to implement their ideas in their projects;