7
i read all my political theory on RT (anarchaos.s3.eu-central-003.backblazeb2.com)
submitted 2 months ago by to c/anarchymemes@anarchist.nexus
9 comments fedilink hide all child comments
 
you are viewing a single comment's thread
view the rest of the comments
[–] 7 points 2 months ago (6 children)

You seen what local models can do? Theres no point in paying for the surveillance apparatus anymore when a 2080 TI Ventus can run models just as good as an entire data center.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] [S] 5 points 2 months ago* (5 children)

    In this case it's an AMD RYZEN AI MAX+ 395 w/ Radeon™ 8060S and 128GB of unified memory, 96GB of which I've dedicated to being VRAM, contained inside a ASUS ROG Flow Z13, but yeah.

    And it runs during max load with less power than most people's gaming PCs use on idle.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 5 points 2 months ago

    Hell yeah bro, strix halo is a fantastic example of how we can leverage the power of contemporary open source LLMs in an environmentally friendly way.

    If you roll it with Linux you can squeeze out even more VRAM - running mine with 126G available for models.

    120W peak at max load. It’s nothing. The data centers are a complete sham, ruining our environment for the sole purpose of capital owners trying to corner an emerging market and accumulate more wealth. Fuck em!

  • permalink
  • fedilink
  • source
  • parent
  • [–] 4 points 2 months ago (1 child)

    Alright, I'm mad jealous. I'm gonna spin one up on my threadripper server when I can afford the power supply repairs and really test it out. But Idk how much the CPU matters.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] [S] 6 points 2 months ago

    yeah, it's pretty nice. for an average image with SDXL it takes about 5 seconds to generate. of course, my setup is a little more advanced than that since I enjoy convincing lonely conservative men on Twitter to give me their money by pretending to be a white christian woman who likes Trump and posting racy pictures, so that's what paid for it.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 3 points 2 months ago (1 child)

    I wish I was rich enough for stuff like that tbh

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] [S] 3 points 2 months ago

    pretend to be a young, white, christian Trump-loving woman who posts racy images to Twitter and you too can have some extra pocket money.

    well, I don't pretend that, I have an abliterated version of Qwen 3.6 35B loaded on my Z13 who does the pretending. I just cash in the bitcoin.

  • permalink
  • fedilink
  • source
  • parent