Looking for a self hosted, web search trends monitor. I have looked at Plausible Analytics, OpenSearch, Matomo, and some other website analytics platforms, but I'm not necessarily wanting to monitor a specific website(s). Rather, I want to monitor what people are searching for on the internet.

Is such a thing possible?

all 12 comments

sorted by: hot top controversial new old
[–] 10 points 11 months ago (7 children)

Your account is marked as a bot, you can change that toggle in your account settings

  • source
  • hideshow 7 child comments
  • [–] [S] 3 points 11 months ago (6 children)

    Weird. How about now? Thanks for the heads up.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 7 points 11 months ago (5 children)

    Still marked as bot for me actually

  • source
  • parent
  • hideshow 5 child comments
  • [–] [S] 6 points 11 months ago (4 children)
  • [–] 5 points 11 months ago (3 children)

    Apparently not good enough lol. Still marked as bot.

  • source
  • parent
  • hideshow 3 child comments
  • [–] [S] 2 points 11 months ago* (2 children)

    Dang it. I unticked the bot box, saved, still no joy.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 4 points 11 months ago (1 child)

    How do you plan to get this data? Most search companies don't share it.

  • source
  • hideshow 1 child comment
  • [–] [S] 3 points 11 months ago

    Well, I've seen datasets from places like Common Crawl, Web Data Commons, Yahoo's Webscope which can be integrated into something like MeiliSearch. I'm going in kind of blind on this, and I don't know if it can be pulled off with the datasets that are publicly available. It's just something that has captured my imagination, and so I am on a fishing trip.

  • source
  • parent
  • [–] 3 points 11 months ago

    That's something worth money so I don't think you're going to find anything good

  • source
  • [–] 1 point 11 months ago

    I'm pretty much sure only free option for finding out what other people search for is Google Trends. It's very valuable data that is hard to get, so the companies that offer it charge quite a lot for it.

  • source