We're a team of researchers, engineers, and designers passionate about building AI systems. We're looking for a Member of Technical Staff to advance the state of the art for model post training and ship state of the art models to production.
Requirements
- Design and write high-performant and scalable software for training models
- Consistently post-train the models to reach SOTA level performance
- Coordinate with other specialist teams to produce models that have strong all encompassing performance
- Craft and implement techniques to improve the performance and results of our training cycles
- Research, implement, and experiment with ideas on our supercompute and data infrastructure
- Proficiency in Python and related ML frameworks such as JAX, Pytorch and XLA/MLIR
- Experience with distributed training infrastructures (Kubernetes, Slurm) and associated frameworks (Ray)
- Experience using large-scale distributed training strategies
- Hands on experience on training large model at scale
- Hands on experience with the post training phase of model training, with a strong emphasis on performance optimisation
Benefits
- An open and inclusive culture and work environment
- Work closely with a team on the cutting edge of AI research
- Weekly lunch stipend, in-office lunches & snacks
- Full health and dental benefits, including a separate budget to take care of your mental health
- 100% Parental Leave top-up for 6 months for employees based in Canada, the US, and the UK
- Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
- Remote-flexible, offices in Toronto, New York, San Francisco and London and co-working stipend
- 6 weeks of vacation
