Worse than that people and brands are going to enshitify the internet In an effort to get their products and brands into the training data with a more positive context.

Just use one AI to create hundreds of thousands of pages of bullshit about how great your brand is and how terrible your competitors brands are.

Then every AI scraping those random pages trying to harvest as much data as possible folds that into their training data set. And it doesn't just have to be things like fake product reviews. Fake peer-reviewed studies and fake white papers. It doesn't even have to be on the surface. It can be buried in a 1000 web servers accessible to scrapers but not to typical users.

Then all the other brands will have to do the same to compete. All of this enshitifying the models themselves more and more as they go.

Self-inflicted digital brain tumors.