13
How does indexing work at huge scales? (programming.dev)
submitted 9 months ago by to c/ask_experienced_devs@programming.dev
4 comments fedilink hide all child comments
 

Youtube would be a prime example: I'm guessing the storage required for the metadata of all videos is too large to be stored on a single server, so how do they achieve millisecond-level performance on searches and handle millions of queries routinely?

What kind of infrastructure and technology is required for this?

Do you have any resources I could use to learn more on this subject?

you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 9 months ago

Some super high level references around eventual consistency, database sharding, edge computing

https://en.wikipedia.org/wiki/Eventual_consistency?wprov=sfti1

https://en.wikipedia.org/wiki/Shard_(database_architecture)?wprov=sfti1

https://en.wikipedia.org/wiki/Edge_computing?wprov=sfti1

  • permalink
  • fedilink
  • source
    •