18 August 2026
Smaller AI models can predict optimal training data repetition
- Researchers found that repeating high-quality training data helps larger language models learn better, but only slightly more repetition is needed as models grow.
- Smaller test models can estimate the right amount of data repetition for much larger models, potentially saving compute resources during development.
