โฒ -8 โผ LLM API client on Nintendo DS Lite (programming.dev) submitted 4 months ago by binaryqueen@programming.dev to c/selfhosted@lemmy.world 34 comments fedilink hide all child comments Did some experiments with my DS Lite and ended up with this. Using DevkitPro libs (libnds, dswifi, calico). Apfel on macOS and a wifi (WEP) bridge running on a RPi Zero 2W. ๐ค
[โ] CallMeAl@piefed.zip 1 point 4 months ago (11 children) Which LLM are you running and what are you running it on? permalink fedilink source parent hideshow 11 child comments replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago* (10 children) This is the model: { "data" : [ { "context_window" : 4096, "created" : 1719792000, "id" : "apple-foundationmodel", "notes" : "Apple on-device model via FoundationModels framework. Unsupported parameters are rejected with 400 when present (except n=1 and logprobs=false). Supported languages: it, zh, fr, en, nb, fr, da, es, es, es, vi, zh, de, pt, tr, en, zh, sv, nl, ja, en, ko, pt", "object" : "model", "owned_by" : "apple", "supported_parameters" : [ "temperature", "max_tokens", "seed", "stream", "tools", "tool_choice", "response_format", "x_context_strategy", "x_context_max_turns", "x_context_output_reserve" ], "unsupported_parameters" : [ "logprobs", "n", "stop", "presence_penalty", "frequency_penalty" ] } ], "object" : "list" } and I'm running it on a MacBook Air M4 16 GB. "Apfel" (the CLI tool) is kinda a wrapper around it and exposes an OpenAI compatible API. permalink fedilink source parent hideshow 10 child comments replies: [โ] CallMeAl@piefed.zip 3 points 4 months ago (9 children) Do I understand correctly that what you've made is a DSLite client to chat with the apple included model on your laptop? permalink fedilink source parent hideshow 9 child comments replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago* (8 children) Exactly, yes. And I use the Raspberry Pi Zero 2W as a WiFi AP (RPi is connected to my home network and to my DS Lite) because the Nintendo DS Lite only supports WEP encryption. So that the DS Lite is able able to send requests to my inference on the MacBook Air permalink fedilink source parent hideshow 8 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (7 children) That's a really neat and fun project! I have a back DSLite that I got the new OS cart for and I've been having fun loading it up with emulators and my favorite games from the past. I love how there is such a vibrant community around DSLite hacking. You should certainly keep doing projects like this and sharing them. I'm glad you shared it because I love hacking projects. However for me this is not on topic for selfhosting even if it is still a very cool project. permalink fedilink source parent hideshow 7 child comments replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago (6 children) Thank you so much, I appreciate your comments. It means a lot to me. :) The only reason why I did this project was because someone showed up in my feed with a post about a DS Lite hack. We're all inspiring each other haha :D However for me this is not on topic for selfhosting I'm always struggling to find the right community for posting. Which place would be the best? permalink fedilink source parent hideshow 6 child comments replies: [โ] CallMeAl@piefed.zip 1 point 4 months ago (5 children) Which place would be the best? The first place to jumps to mind for me is https://hackaday.com/ and if there is a Threadiverse comm for these kinds of projects I would also like to find it. permalink fedilink source parent hideshow 5 child comments replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago (4 children) Let's create a community then? :) permalink fedilink source parent hideshow 4 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (3 children) Go for it! I will happily join it permalink fedilink source parent hideshow 3 child comments replies: [โ] binaryqueen@programming.dev [S] 2 points 4 months ago (2 children) It's called HackShelf permalink fedilink source parent hideshow 2 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (1 child) Nice! got a link? permalink fedilink source parent hideshow 1 child comment replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago* https://programming.dev/c/HackShelf I haven't posted yet but for any upcoming project I will use it =) permalink fedilink source parent
[โ] binaryqueen@programming.dev [S] 1 point 4 months ago* (10 children) This is the model: { "data" : [ { "context_window" : 4096, "created" : 1719792000, "id" : "apple-foundationmodel", "notes" : "Apple on-device model via FoundationModels framework. Unsupported parameters are rejected with 400 when present (except n=1 and logprobs=false). Supported languages: it, zh, fr, en, nb, fr, da, es, es, es, vi, zh, de, pt, tr, en, zh, sv, nl, ja, en, ko, pt", "object" : "model", "owned_by" : "apple", "supported_parameters" : [ "temperature", "max_tokens", "seed", "stream", "tools", "tool_choice", "response_format", "x_context_strategy", "x_context_max_turns", "x_context_output_reserve" ], "unsupported_parameters" : [ "logprobs", "n", "stop", "presence_penalty", "frequency_penalty" ] } ], "object" : "list" } and I'm running it on a MacBook Air M4 16 GB. "Apfel" (the CLI tool) is kinda a wrapper around it and exposes an OpenAI compatible API. permalink fedilink source parent hideshow 10 child comments replies: [โ] CallMeAl@piefed.zip 3 points 4 months ago (9 children) Do I understand correctly that what you've made is a DSLite client to chat with the apple included model on your laptop? permalink fedilink source parent hideshow 9 child comments replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago* (8 children) Exactly, yes. And I use the Raspberry Pi Zero 2W as a WiFi AP (RPi is connected to my home network and to my DS Lite) because the Nintendo DS Lite only supports WEP encryption. So that the DS Lite is able able to send requests to my inference on the MacBook Air permalink fedilink source parent hideshow 8 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (7 children) That's a really neat and fun project! I have a back DSLite that I got the new OS cart for and I've been having fun loading it up with emulators and my favorite games from the past. I love how there is such a vibrant community around DSLite hacking. You should certainly keep doing projects like this and sharing them. I'm glad you shared it because I love hacking projects. However for me this is not on topic for selfhosting even if it is still a very cool project. permalink fedilink source parent hideshow 7 child comments replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago (6 children) Thank you so much, I appreciate your comments. It means a lot to me. :) The only reason why I did this project was because someone showed up in my feed with a post about a DS Lite hack. We're all inspiring each other haha :D However for me this is not on topic for selfhosting I'm always struggling to find the right community for posting. Which place would be the best? permalink fedilink source parent hideshow 6 child comments replies: [โ] CallMeAl@piefed.zip 1 point 4 months ago (5 children) Which place would be the best? The first place to jumps to mind for me is https://hackaday.com/ and if there is a Threadiverse comm for these kinds of projects I would also like to find it. permalink fedilink source parent hideshow 5 child comments replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago (4 children) Let's create a community then? :) permalink fedilink source parent hideshow 4 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (3 children) Go for it! I will happily join it permalink fedilink source parent hideshow 3 child comments replies: [โ] binaryqueen@programming.dev [S] 2 points 4 months ago (2 children) It's called HackShelf permalink fedilink source parent hideshow 2 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (1 child) Nice! got a link? permalink fedilink source parent hideshow 1 child comment replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago* https://programming.dev/c/HackShelf I haven't posted yet but for any upcoming project I will use it =) permalink fedilink source parent
[โ] CallMeAl@piefed.zip 3 points 4 months ago (9 children) Do I understand correctly that what you've made is a DSLite client to chat with the apple included model on your laptop? permalink fedilink source parent hideshow 9 child comments replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago* (8 children) Exactly, yes. And I use the Raspberry Pi Zero 2W as a WiFi AP (RPi is connected to my home network and to my DS Lite) because the Nintendo DS Lite only supports WEP encryption. So that the DS Lite is able able to send requests to my inference on the MacBook Air permalink fedilink source parent hideshow 8 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (7 children) That's a really neat and fun project! I have a back DSLite that I got the new OS cart for and I've been having fun loading it up with emulators and my favorite games from the past. I love how there is such a vibrant community around DSLite hacking. You should certainly keep doing projects like this and sharing them. I'm glad you shared it because I love hacking projects. However for me this is not on topic for selfhosting even if it is still a very cool project. permalink fedilink source parent hideshow 7 child comments replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago (6 children) Thank you so much, I appreciate your comments. It means a lot to me. :) The only reason why I did this project was because someone showed up in my feed with a post about a DS Lite hack. We're all inspiring each other haha :D However for me this is not on topic for selfhosting I'm always struggling to find the right community for posting. Which place would be the best? permalink fedilink source parent hideshow 6 child comments replies: [โ] CallMeAl@piefed.zip 1 point 4 months ago (5 children) Which place would be the best? The first place to jumps to mind for me is https://hackaday.com/ and if there is a Threadiverse comm for these kinds of projects I would also like to find it. permalink fedilink source parent hideshow 5 child comments replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago (4 children) Let's create a community then? :) permalink fedilink source parent hideshow 4 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (3 children) Go for it! I will happily join it permalink fedilink source parent hideshow 3 child comments replies: [โ] binaryqueen@programming.dev [S] 2 points 4 months ago (2 children) It's called HackShelf permalink fedilink source parent hideshow 2 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (1 child) Nice! got a link? permalink fedilink source parent hideshow 1 child comment replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago* https://programming.dev/c/HackShelf I haven't posted yet but for any upcoming project I will use it =) permalink fedilink source parent
[โ] binaryqueen@programming.dev [S] 1 point 4 months ago* (8 children) Exactly, yes. And I use the Raspberry Pi Zero 2W as a WiFi AP (RPi is connected to my home network and to my DS Lite) because the Nintendo DS Lite only supports WEP encryption. So that the DS Lite is able able to send requests to my inference on the MacBook Air permalink fedilink source parent hideshow 8 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (7 children) That's a really neat and fun project! I have a back DSLite that I got the new OS cart for and I've been having fun loading it up with emulators and my favorite games from the past. I love how there is such a vibrant community around DSLite hacking. You should certainly keep doing projects like this and sharing them. I'm glad you shared it because I love hacking projects. However for me this is not on topic for selfhosting even if it is still a very cool project. permalink fedilink source parent hideshow 7 child comments replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago (6 children) Thank you so much, I appreciate your comments. It means a lot to me. :) The only reason why I did this project was because someone showed up in my feed with a post about a DS Lite hack. We're all inspiring each other haha :D However for me this is not on topic for selfhosting I'm always struggling to find the right community for posting. Which place would be the best? permalink fedilink source parent hideshow 6 child comments replies: [โ] CallMeAl@piefed.zip 1 point 4 months ago (5 children) Which place would be the best? The first place to jumps to mind for me is https://hackaday.com/ and if there is a Threadiverse comm for these kinds of projects I would also like to find it. permalink fedilink source parent hideshow 5 child comments replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago (4 children) Let's create a community then? :) permalink fedilink source parent hideshow 4 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (3 children) Go for it! I will happily join it permalink fedilink source parent hideshow 3 child comments replies: [โ] binaryqueen@programming.dev [S] 2 points 4 months ago (2 children) It's called HackShelf permalink fedilink source parent hideshow 2 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (1 child) Nice! got a link? permalink fedilink source parent hideshow 1 child comment replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago* https://programming.dev/c/HackShelf I haven't posted yet but for any upcoming project I will use it =) permalink fedilink source parent
[โ] CallMeAl@piefed.zip 2 points 4 months ago (7 children) That's a really neat and fun project! I have a back DSLite that I got the new OS cart for and I've been having fun loading it up with emulators and my favorite games from the past. I love how there is such a vibrant community around DSLite hacking. You should certainly keep doing projects like this and sharing them. I'm glad you shared it because I love hacking projects. However for me this is not on topic for selfhosting even if it is still a very cool project. permalink fedilink source parent hideshow 7 child comments replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago (6 children) Thank you so much, I appreciate your comments. It means a lot to me. :) The only reason why I did this project was because someone showed up in my feed with a post about a DS Lite hack. We're all inspiring each other haha :D However for me this is not on topic for selfhosting I'm always struggling to find the right community for posting. Which place would be the best? permalink fedilink source parent hideshow 6 child comments replies: [โ] CallMeAl@piefed.zip 1 point 4 months ago (5 children) Which place would be the best? The first place to jumps to mind for me is https://hackaday.com/ and if there is a Threadiverse comm for these kinds of projects I would also like to find it. permalink fedilink source parent hideshow 5 child comments replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago (4 children) Let's create a community then? :) permalink fedilink source parent hideshow 4 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (3 children) Go for it! I will happily join it permalink fedilink source parent hideshow 3 child comments replies: [โ] binaryqueen@programming.dev [S] 2 points 4 months ago (2 children) It's called HackShelf permalink fedilink source parent hideshow 2 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (1 child) Nice! got a link? permalink fedilink source parent hideshow 1 child comment replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago* https://programming.dev/c/HackShelf I haven't posted yet but for any upcoming project I will use it =) permalink fedilink source parent
[โ] binaryqueen@programming.dev [S] 1 point 4 months ago (6 children) Thank you so much, I appreciate your comments. It means a lot to me. :) The only reason why I did this project was because someone showed up in my feed with a post about a DS Lite hack. We're all inspiring each other haha :D However for me this is not on topic for selfhosting I'm always struggling to find the right community for posting. Which place would be the best? permalink fedilink source parent hideshow 6 child comments replies: [โ] CallMeAl@piefed.zip 1 point 4 months ago (5 children) Which place would be the best? The first place to jumps to mind for me is https://hackaday.com/ and if there is a Threadiverse comm for these kinds of projects I would also like to find it. permalink fedilink source parent hideshow 5 child comments replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago (4 children) Let's create a community then? :) permalink fedilink source parent hideshow 4 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (3 children) Go for it! I will happily join it permalink fedilink source parent hideshow 3 child comments replies: [โ] binaryqueen@programming.dev [S] 2 points 4 months ago (2 children) It's called HackShelf permalink fedilink source parent hideshow 2 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (1 child) Nice! got a link? permalink fedilink source parent hideshow 1 child comment replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago* https://programming.dev/c/HackShelf I haven't posted yet but for any upcoming project I will use it =) permalink fedilink source parent
[โ] CallMeAl@piefed.zip 1 point 4 months ago (5 children) Which place would be the best? The first place to jumps to mind for me is https://hackaday.com/ and if there is a Threadiverse comm for these kinds of projects I would also like to find it. permalink fedilink source parent hideshow 5 child comments replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago (4 children) Let's create a community then? :) permalink fedilink source parent hideshow 4 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (3 children) Go for it! I will happily join it permalink fedilink source parent hideshow 3 child comments replies: [โ] binaryqueen@programming.dev [S] 2 points 4 months ago (2 children) It's called HackShelf permalink fedilink source parent hideshow 2 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (1 child) Nice! got a link? permalink fedilink source parent hideshow 1 child comment replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago* https://programming.dev/c/HackShelf I haven't posted yet but for any upcoming project I will use it =) permalink fedilink source parent
[โ] binaryqueen@programming.dev [S] 1 point 4 months ago (4 children) Let's create a community then? :) permalink fedilink source parent hideshow 4 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (3 children) Go for it! I will happily join it permalink fedilink source parent hideshow 3 child comments replies: [โ] binaryqueen@programming.dev [S] 2 points 4 months ago (2 children) It's called HackShelf permalink fedilink source parent hideshow 2 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (1 child) Nice! got a link? permalink fedilink source parent hideshow 1 child comment replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago* https://programming.dev/c/HackShelf I haven't posted yet but for any upcoming project I will use it =) permalink fedilink source parent
[โ] CallMeAl@piefed.zip 2 points 4 months ago (3 children) Go for it! I will happily join it permalink fedilink source parent hideshow 3 child comments replies: [โ] binaryqueen@programming.dev [S] 2 points 4 months ago (2 children) It's called HackShelf permalink fedilink source parent hideshow 2 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (1 child) Nice! got a link? permalink fedilink source parent hideshow 1 child comment replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago* https://programming.dev/c/HackShelf I haven't posted yet but for any upcoming project I will use it =) permalink fedilink source parent
[โ] binaryqueen@programming.dev [S] 2 points 4 months ago (2 children) It's called HackShelf permalink fedilink source parent hideshow 2 child comments replies: [โ] CallMeAl@piefed.zip 2 points 4 months ago (1 child) Nice! got a link? permalink fedilink source parent hideshow 1 child comment replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago* https://programming.dev/c/HackShelf I haven't posted yet but for any upcoming project I will use it =) permalink fedilink source parent
[โ] CallMeAl@piefed.zip 2 points 4 months ago (1 child) Nice! got a link? permalink fedilink source parent hideshow 1 child comment replies: [โ] binaryqueen@programming.dev [S] 1 point 4 months ago* https://programming.dev/c/HackShelf I haven't posted yet but for any upcoming project I will use it =) permalink fedilink source parent
[โ] binaryqueen@programming.dev [S] 1 point 4 months ago* https://programming.dev/c/HackShelf I haven't posted yet but for any upcoming project I will use it =) permalink fedilink source parent