Head of Evaluation and Oversight Research

Scale is a leading data and evaluation partner for frontier AI companies, focusing on research in evaluating and characterizing LLMs. The company seeks a Head of Evaluation and Oversight Research to lead a team of researchers and drive innovation in scaling oversight methods for advanced AI models. The role involves research, design, and collaboration with various research labs.

Requirements

• Track record of impactful research in machine learning (especially in generative AI, evaluation, or oversight)
• Significant experience leading ML research in academia or industry
• Strong written and verbal communication skills for cross-functional collaboration
• Experience building and mentoring research teams
• Publications at top-tier conferences (e.g., NeurIPS, ICML, ICLR, ACL, EMNLP, CVPR)
• Compliance with the U.S. Department of Labor's Pay Transparency provision

Benefits

• Comprehensive health, dental and vision coverage
• Retirement benefits
• Learning and development stipend
• Generous PTO