As Snowden told us, video and audio recording capabilities of your devices are NSA spying vectors. OSS/Linux is a safeguard against such capabilities. The massive datacenter investments in US will be used to classify us all into a patriotic (for Israel)/Oligarchist social credit score, and every mega tech company can increase profits through NSA cooperation, and are legally obligated to cooperate with all government orders.

Speech to text and speech automation are useful tech, though always listening state sponsored terrorists is a non-NSA targeted path for sweeping future social credit classifications of your past life.

Some small LLMs that can be used for speech to text: https://modal.com/blog/open-source-stt

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 11 months ago (3 children)

Oh, I forgot!

You should check out Lemonade:

https://github.com/lemonade-sdk/lemonade

It's supports Ryzen NPUs via 2 different runtimes... though apparently not the 8000 series yet?

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 11 months ago (2 children)

    I've actually been eyeing lemonade, but the lack of Dockerisation is still an issue... guess I'll just DIY it at one point.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 11 months ago* (1 child)

    It's all C++ now, so it doesn't really need docker! I don't use docker for any ML stuff, just pip/uv venvs.

    You might consider Arch (dockerless) ROCM soon; it looks like 7.1 is in the staging repo right now.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 11 months ago

    Due to the fact I am running UnRaid on the node in question, I kinda do need Docker. I want to avoid messing with the core OS as much as possible, plus a Dockerised app is always easier to restore.

  • source
  • parent