It makes sense that if you're trying to create a word predictor, and that predictor generates a weighted average of every connection between words (based on as much text as they can find, pulled across the entire internet), then the word predictor would gravitate towards the generic. And if multiple companies target the same data and probably steal from each other, the output will look the same.
This made me laugh though:
Not only do individual models repeatedly generate similar content,
but different model sizes and families also produce highly repetitive outputs, sometimes sharing
substantial phrase overlaps.
Consider me shocked that if you further collapse the average, it'll look similarly average.