you are viewing a single comment's thread
view the rest of the comments
[–] 14 points 3 months ago (2 children)

Classic bots (e.g. standard web crawlers, as used by search engines, that report their both nature inside their user agent) or the modern LLM-controlled bots that control a full modern browser that also runs javascript?

Because I can imagine they account for the first category, while missing the latter, which have become increasingly more prominent.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 3 months ago (1 child)

    The kind that wants to not appear as a bot is unlikely to send a Linux user agent even if running on Linux.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 3 months ago

    It doesn't have to be on purpose. Web crawlers like Google's specifically identify themselves as a bot. A headless browser just acts like any normal browser, and uses the same user agent as one, just controlled by code rather than a keyboard and mouse.

  • source
  • parent