Applied MLE Evaluations

Hippocratic AI is developing a safety-focused Large Language Model (LLM) for healthcare. They are seeking an Applied Machine Learning Engineer – Evaluations to measure and improve their voice-based generative AI healthcare agents. The role involves designing and implementing evaluation harnesses, analyzing data, and collaborating with cross-functional teams to improve model quality and usability, with a focus on healthcare reliability and user experience.

Requirements

• 4+ years of experience in applied ML, ML engineering, or AI evaluation
• Strong skills in Python, with experience in data processing, experiment tracking, and model analysis
• Familiarity with LLM evaluation methods and multimodal systems
• Understanding of prompt engineering, model fine-tuning, and RAG techniques
• Comfortable collaborating with cross-functional partners