all 23 comments

sorted by: hot top controversial new old
[–] 17 points 6 months ago* (last edited 6 months ago) (4 children)

Yep, and I love it.

I've got a little Banana Pi M4 Zero (PiZero form factor but much more powerful and with 4 GB RAM) loaded up with, among other useful tools, Kiwix and the full Wikipedia dump. I just refreshed it with the 2026-02 full dump, so I'm caught up for the year. I've also got a lot of other offline docs loaded up (React, Bun, and the devdocs for several libraries I use) and it's nice to have local copies of those instead of googling every time.

Surprisingly, the full ~130 GB Wikipedia dump works fine on a regular Pi Zero 2 with 512 MB RAM. I don't know how ZIM works but it does work very very well.

  • source
  • hideshow 4 child comments
  • [+] [S] 3 points 6 months ago* (last edited 6 months ago) (1 child)
  • [–] 6 points 6 months ago

    130GB for the entire thing? And the pi doesn't choke on indexing / searching it?

    That was my thought. I knew it couldn't hold it in RAM but thought it would be doing crazy IO and limited by being on SD, but it seems to not be a problem. Like I said, I don't know how ZIM does it, but it does it well. Must have some kind of index that lets it fast travel to the correct blocks or something. I dunno lol.

    how capable is the search engine (I assume it has one?)

    Yep, it has search. It's....okay but kind of primitive. It's not slow, and if you're searching for something that's fairly unique (as far as keywords go), it does well. But if you're searching something like an acronym where it shows up as a regular word in other entries, it's a lot more hit or miss.

  • source
  • parent
  • [–] 3 points 6 months ago (2 children)

    Similar setup here. Orangepi zero that starts kiwix server at boot and switches the wifi to AP mode. Just plug it in, connect to kiwix WiFi, access kiwix.local via phone browser, and shazam.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 6 months ago* (1 child)

    Nice! Those AllWinner boards are a little tricky to get going and have some quirks, but the price is great for the extra horsepower you get. Granted, I use the latest Armbian since the manufacturer's images are all quite old.

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (-1 replies)
    [–] 32 points 6 months ago (3 children)

    Yes, and I actually use it to train a local llm so I'm not hammering the internet. I have a ton of storage, and like to keep my kids in the sandbox, so we have wikipedia, project gutenberg, kahn academy, and a bunch of others all hosted behind an apache reverse proxy which is using mellon so there's LDAP auth.

  • source
  • hideshow 3 child comments
  • [–] 4 points 6 months ago (1 child)

    Do you actually train the LLM or use RAG? I have been looking for a local LLM + Wikipedia RAG solution for a while now.

    For now I just have kiwix-serve + searxng doing a simple search but the Kiwix search is...questionable.

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (-1 replies)
    [–] 7 points 6 months ago

    Checkout internet in a box. Easy to setup, update and select datasources which include wikipedia among many. https://internet-in-a-box.org/

  • source
  • [–] 4 points 6 months ago
    [–] 4 points 6 months ago

    I got Kiwix at home and on my iPhone it rocks.

  • source
  • [–] 4 points 6 months ago

    Yes, I self host the English Wikipedia dump, as well as a few cooking sites and topic specific stack exchange dumps available in zim format.

    My goal is:

    • reduce dependence on public internet. In the event of an outage or restriction I’d like some books and other content I can use to entertain myself
    • locally preserve a snapshot of information before it is possibly diluted by LLM edits
  • source
  • Yes, I host Wikipedia, Wiktionary, and a few other resources. Very convenient, and the full Wikipedia is only like 100 gigs.

  • source
  • [–] 3 points 6 months ago

    The full Wikipedia is saved on my mobile phone thanks to Kiwix

  • source
  • [–] 2 points 6 months ago

    Yes. This is my ansible role that deploys it

  • source
  • [–] 2 points 6 months ago (1 child)

    Is there an actual download link? They want $20 for the Raspberry Pi image

  • source
  • hideshow 1 child comment
  • [–] 2 points 6 months ago

    I switched to an N150 some time ago, but I previously had it running perfectly on a Pi 4 with only 2GB of RAM. There’s actually a lot more content available than just Wikipedia! You can even archive your own websites using https://zimit.kiwix.org

    It’s fun and Kiwix is impressively lightweight, it uses less than 50 MB of RAM, even with an article loaded.

    https://imgur.com/a/DmmqJdh

  • source
  • [–] 1 point 6 months ago

    Yes, it’s helpful

  • source
  • [–] [B] 1 point 6 months ago* (last edited 6 months ago)

    Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I've seen in this thread:

    Fewer Letters More Letters
    AP WiFi Access Point
    HTTP Hypertext Transfer Protocol, the Web
    NAS Network-Attached Storage
    VPN Virtual Private Network

    4 acronyms in this thread; the most compressed thread commented on today has 6 acronyms.

    [Thread #261 for this comm, first seen 29th Apr 2026, 12:00] [FAQ] [Full list] [Contact] [Source code]

  • source