Senior Machine Learning Engineer - Orchestration - Applied AI & LLMs (x/f/m)

Set a new pulse for healthcare!

What you'll do

• Define and own the evaluation strategy for our AI agentic system — metrics, protocols, datasets, and tooling
• Implement and maintain automated evaluation pipelines to monitor model quality, safety, and alignment across iterations
• Run systematic experiments to assess reasoning, factuality, robustness, and user experience
• Collaborate closely with model developers and research scientists to provide insights and drive iterative improvement
• Contribute to research and internal knowledge sharing on LLM evaluation methodologies and best practices

Life at Doctolib Tech

• Our solutions are built on a single fully cloud-native platform that supports web and mobile app interfaces, multiple languages, and is adapted to country and healthcare specialty requirements.
• Our stack is composed of Rails, TypeScript, Java, Python, Kotlin, Swift, and React Native.
• We leverage AI ethically across our products to empower patients and health professionals. Discover our AI vision here.

Who you are

• Hold an MSc or PhD in Computer Science, Machine Learning, Data Science, or a related field
• Have 7+ years of hands-on experience working with large language models (e.g., GPT, Claude, Llama, or BERT-like architectures)
• Have proven experience evaluating agentic or reasoning systems (e.g., autonomous agents, tool-using LLMs, dialogue systems, or task-oriented assistants)
• Have a strong track record in experiment design, metric definition, and evaluation automation
• Are able to bridge research and production, influencing both modeling and product decisions
• Have excellent communication skills, a collaborative mindset, and are fluent in English

• Have experience in the clinical or medical domain and sensitivity to ethical or regulatory challenges in healthcare AI

What we offer

• Free comprehensive health insurance (basic package) for you and your children
• 25 days of paid vacation per year, plus up to 14 days of RTT
• Free mental health and coaching services through our partner Moka.care
• Work from abroad for up to 10 days per year thanks to our flexibility days policy
• Lunch vouchers (Swile card) worth €8.50 per working day, with €4.50 covered by Doctolib
• A subsidy from the work council to refund part of the membership to a sport club or a creative class
• 50% reimbursement of your public transport subscription
• Parent Care Program: receive one additional month of leave on top of the legal parental leave
• Enrollment in Doctolib's long-term employee value sharing plan called DoctoGrowth
• For caregivers and workers with disabilities, a package including an adaptation of the remote policy, extra days off for medical reasons, and psychological support
• Relocation support in case of international mobility
• Access to the best AI tools for coding, development and dedicated training

Our interview process

• Recruiter Interview
• Technical Deep Dive
• Data System Design
• Behavioral Interview
• At least one reference check

Job details

• Permanent position
• Full-time
• Hybrid in our Levallois-Perret office (up to 2 remote days per week)
• Start date: as soon as possible

We welcome everyone

Your data privacy