Senior LLM Quality Analyst

Join MagicSchool as a Senior LLM Quality Analyst and work with the Trust, Safety and Quality team to ensure MagicSchool's AI outputs meet the highest standards for educators and students. You will design and execute experiments to test prompt strategies, evaluate model performance, and maintain dashboards.

Requirements

• Design and Execute Prompt Engineering Experiments
• Maintain Response Quality Reporting and Dashboards
• Evaluate and Improve AI Outputs
• Stay Current on LLM Best Practices

Benefits

• Unlimited time off
• Choice of employer-paid health insurance plans
• Dental and vision insurance
• 401k match
• Monthly wellness stipend
• Generous stock options