Self-distillation on math: data

Setting up the data needed to train and evaluate simple self-distillation for competitive math.

read more →

Self-distillation on math: intro

Improving LLM performance on competitive math through unverified self-distillation.

read more →