… by running your own instance of the free and open-source federated metasearch engine SearXNG on OpenBSD!

top 47 comments

sorted by: hot top controversial new old
[–] 29 points 11 months ago (6 children)

There is also a list of publicly operated SearXNG instances at https://searx.space/. We host the one at https://search.freestater.org/, and there are plenty of other good ones.
bVuZT3n0X1rOSXk.jpg

  • source
  • hideshow 6 child comments
  • [–] 3 points 11 months ago (5 children)

    Who says they are securely operated and don't store any data??

  • source
  • parent
  • hideshow 5 child comments
  • [–] 7 points 11 months ago (1 child)

    who says that about any search engine? can you trust them? searXNG is usually run by random people who are less likely to use your data than a larger search company

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 11 months ago* (1 child)

    The devs at SearXNG have a bot that regularly scans the public instances for changes to the source code and delists them as a public instance if it's altered.

    If you go to https://searx.space, they show the results of the scans for each instance.

    The software is free and open source. You are encouraged to inspect the code yourself to make sure no data is collected!

    Here is the source code: 

    https://github.com/searxng/searxng

  • source
  • parent
  • hideshow 1 child comment
  • [–] 23 points 11 months ago

    I run it in a container on Kubernetes. Definitely recommend.

  • source
  • [–] 18 points 11 months ago (3 children)

    I still don't understand how Searx is able to operate for free. Don't the API calls cost money?

  • source
  • hideshow 3 child comments
  • [–] 16 points 11 months ago (2 children)

    look at that domain name! respect

  • source
  • hideshow 2 child comments
  • load more comments (1 reply)
    [–] 7 points 11 months ago* (5 children)

    Or how about YaCy. It's self-hostable & you can have your own web index and start your own web-crawler.

    It's peer-to-peer too

  • source
  • hideshow 5 child comments
  • [–] 3 points 11 months ago (1 child)

    This is exactly what I came here to find. Thank you for posting it. If I can be so bold selfhosters should really be leaning this way searxng is great but it still uses big tech.

    The other thing we need is a way to identify good crawling agents or *smol agents over corporate bots that just steal content.

    If selfhosters can unite and build a good index perhaps searching can go back to the way it was vs a vector to sell you more and collect your data.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 12 points 11 months ago* (4 children)

    For anyone wondering xn--gckvb8fzb.com is マリウス.com

    Also: Maybe they should get a "normal" domain when you post english articles...

  • source
  • hideshow 4 child comments
  • [–] [S] 1 point 11 months ago* (3 children)

    Does the url not resolve on certain browsers or something? I usually just copy/paste or use a firefox plugin to generate posts for lemmy/piefed/fediverse.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 6 points 11 months ago* (last edited 11 months ago) (2 children)

    It resolves well but punnycode is disabled in some browsers or security enhanced profiles, so that you can easier detect punnycode domains that try to fake other domains.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 5 points 11 months ago* (last edited 11 months ago)

    It's not federated tho?

    What do they mean when they call it that?

  • source
  • [–] 5 points 11 months ago (1 child)

    Thanks for posting, both a great reminder to try setting this up on my unraid, and also to add the RSS feed of that site to Feeder.

  • source
  • hideshow 1 child comment
  • [–] 5 points 11 months ago* (last edited 11 months ago) (8 children)

    I used to self-host searxng for a while, but somehow the search results were always off and mixed with to much non-relevant results :/.

    It's not about searxng itself... Rather how the most relevant info gets drown into AI slope and non-sense bullshit. The best blogposts/info are transmitted from people to people...

    I'm kinda sad to admit that stupid AI "solved" this issue and had better results :/

  • source
  • hideshow 8 child comments
  • [–] 3 points 11 months ago* (3 children)

    I used to self-host searxng for a while, but somehow the search results were always off and mixed with to much non-relevant results :/.

    I mean, getting non-relevant results happens with every search engine anymore.

    The days of your search results being relevant, and what you want on the first page, are long dead thanks to SEO and other factors.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 11 months ago (2 children)

    Yeah you're right ! However, ages ago, I still remember how you could go to page 20+ and still find some really interesting things !

    Here, past page 2 it's just some random shit...

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 11 months ago (1 child)

    Most of its just AI generated websites. Search for any topic and you're likely to get 50 AI generated website that give a similar bulletpoint presentation of what search item X is according to the AI that generated the site.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 11 months ago

    50 AI generated website that give a similar bulletpoint presentation of what search item X is according to the AI that generated the site.

    Yeah that's what I meant by "random" shit ! 😁

  • source
  • parent
  • [–] 2 points 11 months ago (3 children)

    You can self host that too ;)

    OpenWebUI + Ollama + SearxNG. OpenWebUI can do llm web search using the engine of your choice (even self hosted SearxNG!). From there it's easy to set the default prompt to always give you the top (10, 20, whatever) raw results so you're not confined to ai results. It's not quite duck.ai slick but I think I can get there with some more tinkering.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 3 points 11 months ago (1 child)

    Is there a guide on how to do this on Linux + 16GB Radeon?

  • source
  • parent
  • hideshow 1 child comment
  • [–] 6 points 11 months ago* (last edited 11 months ago)

    I mean, I could write one! I kind of just pieced it together from guides on the three individuals

    Edit: back of the napkin guide below is basically in the OpenWebUI docs already! I use NixOS (btw) but docker/podman should work well.

    OpenWebUI + Ollama setup -- tl;dr docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main

    OpenWebUI SearXNG guide -- a little more involved, but not difficult.

  • source
  • parent
  • [–] 7 points 11 months ago

    Is metasearch really the best we can do? What about YaCy, or something else more like that?

  • source
  • [–] 6 points 11 months ago (5 children)

    The search engines that searxng interact with still track you. For this reason I will always use a public instance to mix up the tracking with everyone else using it.

  • source
  • hideshow 5 child comments
  • [–] 0 points 11 months ago (4 children)
  • [–] 4 points 11 months ago (3 children)

    Using a public instance is more private than using a private selfhosted instance.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 3 points 11 months ago
    [–] 4 points 11 months ago (2 children)

    Brave is a search engine?
    That's news to me.

  • source
  • hideshow 2 child comments
  • load more comments (1 reply)