having llm output in your training set is irrecoverable
i used to think model collapse was an actual problem for LLMs as well, but it turns out that most popular models nowadays use intentionally synthetic data for things like reasoning traces and math. a lot of models (like gemini) also have subtle watermark patterns that let the trainers just filter out llm responses for factual data