LLMOps Engineer

ориентир по рынку

вакансия зп не указана

в среднем 306 131 ₽

мэтч

Загрузи резюме, чтобы видеть мэтчи с вакансиейЗагрузи резюме, чтобы видеть мэтч с вакой

подготовься к отклику

ai-инструменты

Чтобы адаптировать резюме под вакансию или составить сопроводительное письмо, загрузи резюме

Applicants based in Russia or Belarus cannot be considered. For specific project opportunities, we conduct a live technical session together.

Описания нет

Select, benchmark, and deploy open-source LLMs and embedding models
Serve models in production using vLLM, TGI, Ollama, or similar frameworks
Run and optimize on-premises and private-cloud GPU infrastructure
Tune latency, throughput, memory, and cost through quantization, batching, and caching
Set up monitoring, logging, and scaling for model serving
Work with AI and DevOps engineers to bring RAG and agent systems into production

Hands-on experience running LLMs in production on your own infrastructure, not only through OpenAI or Anthropic APIs
Experience with vLLM, TGI, Ollama, Triton, or similar serving frameworks
Solid Linux, Docker, and Kubernetes skills, including GPU workloads
Python skills
English at B2 level or higher
Будет плюсом: Quantization (GPTQ, AWQ, GGUF) and inference optimization, fine-tuning (LoRA / QLoRA), monitoring with Prometheus / Grafana, experience with air-gapped or highly secure environments

Freelance project
Long-term collaboration opportunities
Challenging AI projects to deepen expertise and develop technical skills
Opportunities to work with modern AI technologies and solve real-world engineering problems
A small, experienced team that values engineering quality

llmops llm python kubernetes docker linux mlops vllm tgi ollama triton gpu quantization fine-tuning prometheus

Если просят выйти из iCloud, прислать код из SMS, запустить или установить что-то, перевести деньги — не соглашайся: это мошенничество.