I already know it's not that easy and that the Internet is constantly expanding, but I really wonder if it's possible to very roughly estimate its size

you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 3 weeks ago (2 children)

Something I always find kind of puts the scale into perspective, is that all these AI companies have a huge interest in storing as much of the internet's data as possible, because they need access for training and it ensures they continue to have access to relatively high-quality (it's only going to get worse with more and more content on the internet being generated).

And yet, even with their trillions of investor money, they evidently don't have it all stored. Because they still regularly hammer all kinds of webpages with an insane number of requests, when they do their trainings.

  • source
  • hideshow 2 child comments