LLM training data: “Historical, debunked data makes it into the models and is preferred by the model output. There is much more outdated, harmful information published than there is updated, correct information. Hence statistically more viable.”

https://axbom.me/objects/e8108a24-f914-4f39-8637-276fc2e71f31