"tHe PrOgReSs hAs bEeN iNsAnE"

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 5 hours ago (1 child)

Thank you so much for your detailed response! My user tag I don’t remember setting for you proves correct again!

I never ended up picking up a steam deck cuz I don’t leave the house, so I’ll be using a desktop with maybe a 1070 or 2070s maybe? I’ve never tried Bazzite but I’ve got a bunch of different distros on various machines at home. I’ll throw Bazzite on my Medicat drive. Thank you so much again!

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 5 hours ago*

    YMMV with other hardware, I genuinely have no clue rofl!

    Maybe start with 2B... try to work up from there?

    Maybe Nvidia cards are just... better generally, due to generally better CUDA support for LLMs than ROCm?

    I have no idea!

    The Deck uses an AMD APU, RDNA 2, shared LPDDR5 RAM... so... yeah i have no idea how to translate that to a more standard PC set up, in terms of performance expectations. Tooooo many variables.

  • source
  • parent