▲ 646 ▼ Itch.io deindexes NSFW games after becoming the latest target of skittish credit card companies and anti-porn group Collective Shout, catching an award-winning indie and more in the crossfire (www.pcgamer.com) submitted 1 year ago by themachinestops@lemmy.dbzer0.com to c/technology@lemmy.world 83 comments fedilink hide all child comments Few days ago: https://www.thegamer.com/steam-removes-adult-games-because-of-collective-shout-feminist-anti-abortion-group/
[–] MonkderVierte@lemmy.zip 1 point 1 year ago (1 child) But (not-meta)search engines crawl websites. permalink fedilink source parent hideshow 1 child comment replies: [–] mriswith@lemmy.world 2 points 1 year ago* Exactly. They "crawl" category/tag lists, etc. and follow links. And if there are no links to those pages, they wont be indexed. (Depending on some settings. For all I know they've set up "hidden redirects" for popular crawlers to pages that show them) permalink fedilink source parent
[–] mriswith@lemmy.world 2 points 1 year ago* Exactly. They "crawl" category/tag lists, etc. and follow links. And if there are no links to those pages, they wont be indexed. (Depending on some settings. For all I know they've set up "hidden redirects" for popular crawlers to pages that show them) permalink fedilink source parent