python developer

MDiet is an early-stage HealthTech startup developing an AI-powered platform that helps reduce patient readmissions. The product targets the US healthcare market.

• Design and build multi-step LLM agents and pipelines for medical data curation;
• Develop production RAG systems with high grounding and citation quality;
• Deploy and optimize self-hosted LLM inference (vLLM) with cost and throughput optimization;
• Fine-tune open-source models on domain-specific medical data with measurable improvement;
• Build data pipelines and versioning for documents, embeddings and training data;
• Create evaluation frameworks, guardrails and hallucination control systems;
• Implement reliable structured output and data extraction;
• Work closely with physicians and Platform Architect.

• Strong hands-on experience with production LLM systems (RAG + agents + inference);
• Experience with fine-tuning open-source LLMs (LoRA/QLoRA/PEFT) with measurable results;
• Experience building data pipelines and versioning for LLM/RAG workloads;
• Strong skills in evaluation, hallucination reduction and structured output;
• Production Python + FastAPI + async processing;
• Experience with self-hosted inference (vLLM or similar) and GPU optimization;
• English proficiency at C1 level (strong written and spoken communication skills);
• Bachelor’s degree (or higher) in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related technical field;
• 5+ Years in ML/AI, with 1.5–2+ years in production LLM projects;
• Experience with MLOps;
• Nice to have: Experience in medical / clinical NLP or regulated domains, cost modeling and optimization of LLM workloads, MLOps and production fine-tuning pipelines, Apache Airflow, Prometheus/Grafana, or AI Solution Architecture, publications in relevant fields.

• Equity;
• Relocation support is available to the US upon successful company growth (discussed individually).