machine learning engineer

Inworld AI is a research lab of top researchers and engineers, building top-ranked realtime voice models that power consumer-facing AI applications across health, fitness, learning, therapy, companions, customer experience, and media.

• Build, break, and understand systems in a fast-paced environment;
• Optimize realtime inference and scale distributed systems;
• Take a model from the research team, containerize it, optimize its serving, and ensure it runs reliably in production.

• Deep understanding of modern serving frameworks and techniques like vLLM or TRT-LLM;
• Hands-on experience with quantization, distillation, caching strategies, continuous batching, paged attention, and speculative decoding;
• Proficiency in C++, CUDA, Rust, or highly optimized Python, with the ability to profile code and squeeze performance out of NVIDIA GPUs;
• Experience with Kubernetes, Ray, custom load balancing, multi-GPU/multi-node inference, and handling concurrent connections;
• PhD in CS, Physics, Math, or equivalent practical experience building backend or ML systems;
• Professional fluency in English (written and spoken);
• Nice to have: Non-trivial systems programming projects, open-source contributions to major inference engines, or deep-dive technical write-ups.

• Full U.S. visa and relocation support may be available for candidates interested in relocating to the San Francisco Bay Area in the future, subject to business needs and applicable legal and work authorization requirements.