There are various theories around model collapse when you train on too much AI generated data (that's not for distillation).
There are various theories around model collapse when you train on too much AI generated data (that's not for distillation).