I thought my first comment would make it clear that I'm very much not pro-AI so I'm not sure why I'm getting a lecture on anthropomorphizing it.
But there's still a lot wrong with your comment. You're assuming that the data set never change and the parameters are never tweaked which is wildly untrue. Answers like this are not a common occurrence anymore because when a new one pops up, companies have a vested interest in updating the system instructions.
I'm not saying the summaries are good now. Just that most of the outrageous answers have long since been fixed