For , the extra training that tailors them to specific tasks (called post-training) requires human expertise and is time-consuming. Automating this process could speed up AI development.
Researchers built a suite of training tasks from research papers, collected examples of successful post-training from advanced models, and kept only the best examples to train smaller models.
The trained models improved by 8.74 to 16.87 points on a standard benchmark, matching top models. This shows that automated post-training can be learned from quality examples.
