you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 1 year ago (1 child)

But (not-meta)search engines crawl websites.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 1 year ago*

    Exactly. They "crawl" category/tag lists, etc. and follow links. And if there are no links to those pages, they wont be indexed.

    (Depending on some settings. For all I know they've set up "hidden redirects" for popular crawlers to pages that show them)

  • source
  • parent