you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 9 months ago (4 children)

I have a Strix Halo machine with 128GB VRAM so I'm definitely going to give this a try with gpt-oss-120b this weekend.

  • source
  • hideshow 4 child comments
  • [+] [S] 3 points 9 months ago* (last edited 6 months ago) (2 children)
  • [–] 5 points 9 months ago (1 child)

    Of course, self hosted with llama-swap and llama.cpp. :)

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (-1 replies)
  • load more comments (-1 replies)