Our key finding is that by injecting information through an external synthetic data verifier, whether a human or a better model, synthetic retraining will not cause model collapse.
Yeah if you have a source of truth then your model is basically getting trained on that.
It’s like already having the answer
My point was that having a verifier means your not really training a model on another model’s data, it’s basically as if you get new raw data from a non AI source