I will ask Santa Claus for that GPU <3

I don't want to create an extra post, so I ask here.

Where do you guys get your hardware from, for an affordable price?

I'd like to run at least a 27b model but my hardware is too weak. I'm on a 16GB unified mem, M4. Tried running Bonsai 27b (it's Qwen architecture) but I had to close all other apps and it is not in a state that I could work with it.

Thank you for that! I'm currently developing an app and need good RSS feeds, found it!

https://programming.dev/c/HackShelf

I haven't posted yet but for any upcoming project I will use it =)

It's called HackShelf

Let's create a community then? :)

Thank you so much, I appreciate your comments. It means a lot to me. :)

The only reason why I did this project was because someone showed up in my feed with a post about a DS Lite hack. We're all inspiring each other haha :D

However for me this is not on topic for selfhosting

I'm always struggling to find the right community for posting. Which place would be the best?

Exactly, yes. And I use the Raspberry Pi Zero 2W as a WiFi AP (RPi is connected to my home network and to my DS Lite) because the Nintendo DS Lite only supports WEP encryption. So that the DS Lite is able able to send requests to my inference on the MacBook Air

This is the model:

{
  "data" : [
    {
      "context_window" : 4096,
      "created" : 1719792000,
      "id" : "apple-foundationmodel",
      "notes" : "Apple on-device model via FoundationModels framework. Unsupported parameters are rejected with 400 when present (except n=1 and logprobs=false). Supported languages: it, zh, fr, en, nb, fr, da, es, es, es, vi, zh, de, pt, tr, en, zh, sv, nl, ja, en, ko, pt",
      "object" : "model",
      "owned_by" : "apple",
      "supported_parameters" : [
        "temperature",
        "max_tokens",
        "seed",
        "stream",
        "tools",
        "tool_choice",
        "response_format",
        "x_context_strategy",
        "x_context_max_turns",
        "x_context_output_reserve"
      ],
      "unsupported_parameters" : [
        "logprobs",
        "n",
        "stop",
        "presence_penalty",
        "frequency_penalty"
      ]
    }
  ],
  "object" : "list"
}

and I'm running it on a MacBook Air M4 16 GB. "Apfel" (the CLI tool) is kinda a wrapper around it and exposes an OpenAI compatible API.

That's really cool!

I use the Kaico DSpico Flashcart and on the RPi Zero 2W I use a bash script (because I don't want to host it permanently) with hostapd, iw, dnsmasq, socat, and iproute2. For HTTP and JSON I use my own implementation, no library. The rest is documented in the post.

Did some experiments with my DS Lite and ended up with this. Using DevkitPro libs (libnds, dswifi, calico). Apfel on macOS and a wifi (WEP) bridge running on a RPi Zero 2W. 🖤

I changed the title

Thank you

Thank you, you know these days small things make me happy

all of it. I'm not using anything outside of my own local area network.

Uhm, I figured out that people don't like it. However, for me, it was a nice little project and it brightened my day.

Hi, I do have Reddit accounts and they don't want me to delete my accounts! I tried to delete but the submit button for deletion is grayed out. Help.

I haven't seen iron man. What can it do? Wearables are interesting.

Nice job :)

For the record: I have savings I'm deliberately not touching. Hence posting in a community literally called "No Stupid Questions."

I'm often asking myself "how can I make this happen?" instead of just giving up and waiting for cashflow.