When I first got into local LLMs nearly 3 years ago, in mid 2023, the frontier closed models were ofcourse impressively capable.

I then tried my hand on running 7b size local models, primarily one called Zephyr-7b (what happened to these models?? Dolphin anyone??), on my gaming PC with 8GB AMD RX580 GPU. Fair to say it was just a curiosity exercise (in terms of model performance).

Fast forward to this month, I revisit local LLM. (Although I no longer have the gaming PC, cost-of-living-crisis anyone 😫 )

And, the 31b size models look very sufficient. #Qwen has taken the helm in this order. Which is still very expensive to setup locally, although within grasp.

I'm rooting for the edge-computing models now - the ~2b size models. Due to their low footprint, they are practical to run in a SBC 24/7 at home for many people.

But these edge models are the 'curiosity category' now.

I've been blogging over 4 years and the reach has Plateaued.

I'm wondering if there is any service that helps reach/discoverability (like medium platform) while I stick to my own hosting?

Thanks!

Maybe I've been mind controlled, but I'm used to the algorithmic feed of youtube and reddit. The default simple reverse chronological method of mastodon is hard to use for me.

I'm not interested in reading each and every post, but prefer the most sensational ones upfront..

I've tried googling but couldn't find much apart from a third party website I had to put my login creds into..

Do you guys have a better solution for this?

cross-posted from: https://lemmy.ml/post/44422946

Just curious if any people make steady income from a side devblog? I know there are dedicated youtubers, but I'm not into that..

I've been blogging over 4 years but the reach is still poor, just wanna rethink my strategy..

Thanks!

Just curious if any people make steady income from a side devblog? I know there are dedicated youtubers, but I'm not into that..

I've been blogging over 4 years but the reach is still poor, just wanna rethink my strategy..

Thanks!

HI

I'm looking to write a programming guide for general line cortex-M0 TI MSPM0G1106.. For C, covering the main peripherals, SPI, DMA etc..

Using the sphinx book structure.

I'm choosing to write this because, though there are good beginner books for STM32, there's none for TI..

I'm semi experienced in the field.

But I've written article series on other microcontrollers in the past in my blog. Anyone willing to critique them?

Many thanks :)

Here's a risc-v one: https://simplycreate.online/tags/ch592

I'm a long time reddit user.. I should say I'm quite hooked. But lemmy feels a lot quiet. My primary interests are electronics, embedded programming, piracy 😏 and selfhosting. Apart from the last community the others are quite deserted.

I'v been on and off since past 1 1/2 years. No change..

On the other hand Mastodon is going well. And I nurture the interactions there. Lemmy could be the same. I too feel Reddit is kinda on-to-your face and aggressive.