software engineer for AI inference

Anthropic develops AI systems designed to be reliable, interpretable, steerable, safe, and beneficial. Its Inference team builds and maintains systems that serve Claude to millions of users worldwide, including compute-agnostic inference deployments and infrastructure for AI research.

• Design intelligent routing algorithms to optimize request distribution across thousands of accelerators
• Autoscale the compute fleet to match supply with demand across production, research, and experimental workloads
• Build production-grade deployment pipelines for releasing new models to millions of users
• Integrate new AI accelerator platforms
• Contribute to inference features such as structured sampling and prompt caching
• Support inference for new model architectures
• Analyze observability data to tune performance based on real-world production workloads
• Manage multi-region deployments and geographic routing for global customers

• Significant software engineering experience, particularly with distributed systems
• A results-oriented approach, flexibility, and focus on impact
• Willingness to take on work beyond the job description
• Interest in learning about machine learning systems and infrastructure
• Ability to thrive where technical excellence drives business results and research breakthroughs
• Care about the societal impacts of your work
• Bachelor’s degree or an equivalent combination of education, training, and/or experience
• Relevant field of study, demonstrated through coursework, training, or professional experience
• Будет плюсом: High-performance, large-scale distributed systems, implementing and deploying machine learning systems at scale, load balancing, request routing or traffic management systems, LLM inference optimization, batching and caching strategies, Kubernetes, cloud infrastructure (AWS, GCP), Python, Rust

• Annual salary: €235.000 — €295.000 EUR
• Staff are expected to be in an office at least 25% of the time; some roles may require more office time
• Visa sponsorship is available, subject to role and candidate eligibility; the company will make reasonable efforts to obtain a visa and provides assistance from an immigration lawyer