I tried 14 different models running locally on my 12 core Xeon workstation. It's no slouch, even as old as it is, it rips through compiles and such. But when it comes to local LLM performance, it's clown shoes. Model performance ranged from the merely blah to the outright absurd. None of it worth a runny wildebeest shit. All of it complete aardwolf cankers. So now I know. One day I'll run a good model on real hardware I own and do some good in the world with it. That day won't be soon. Until then, it's back to books and hand-coding.Who knows, by then maybe the price of GPUs will come back down to sanity.

no comments (yet)

sorted by: hot top controversial new old
there doesn't seem to be anything here