you are viewing a single comment's thread
view the rest of the comments
[–] 8 points 1 year ago

If you allow my searchxng search scraper then an AI scraper is indistinguishable.

If you mean, "google and duckduckgo are whitelisted" then lemmy will only be searchable there, those specific whitelisted hosts. And google search index is also an AI scraper bot.

  • source
  • parent