[–] 34 points 1 week ago

I agree with this take. Lots of uncertainty because LLMs are rubbish at probably solving (which is a human's strength). LLMs don't have a semantic understanding of the problem they've been tasked with solving.

tl;dr LLMs are useful tool but not software engineers.

  • source
  • parent
  • context
  • [–] 6 points 1 week ago

    I agree that Intel is overvalued. My point is that you need to zoom out to get a better picture. And a stock that's up 200% over 2 years is doing really well. It's funny because your point about percentages was reflected this morning, Intel has slid another 6% so now it's only up 175% over the past 2 years.

  • source
  • parent
  • context
  • [–] 3 points 2 months ago (1 child)

    I have a RTX4090 (24GB VRAM) plus 128GB DDR4 system RAM on Ubuntu 24.04 and I am running these models locally

    | Model | Speed | Context window | |


    |


    |


    | | Qwen3.8-Flash-Next UD-Q4_K_XL — 125B/6B-active hybrid MoE, 104 GB | ~16.7 tok/s | 128k tokens | | GLM-5.3-Flash UD-IQ3_XXS — 320B/18B-active MoE, 120 GB | ~9 tok/s | 128k tokens | | Qwen3.8-27B UD-Q4_K_M — dense hybrid, 16 GB, fully on the 4090 | ~49 tok/s | 262k tokens |

    The larger models don't fit on the GPU alone but they're mixture-of-experts and their active weights easily fit on the 24GB. The bottleneck is my system RAM as llama.cpp has to constantly move the experts between RAM and VRAM. I'm running older hardware, AM4 CPU, DDR4 RAM, etc. so 128GB is my limit on system memory and it's relatively slow compared to DDR5. With DDR5 I would expect a good bump in speed for Qwen 3.8 Flash Next and GLM 5.3 Flash.

    I also have a Kimi subscription which I use as my daily agentic driver and use DeepSeek for random tasks (DeepSeek Flash 4.1 is really fast and cheap).

  • source
  • parent
  • context
  • [–] 6 points 2 months ago (9 children)

    The Anthropic and OpenAI valuations require their models to replace humans. But LLM based AI can't replace humans because LLMs can't make decisions. I only use Chinese models now, they're fast, and they can finish a coding task quicker than I can make an informed decision about the next task.

  • source
  • [–] 9 points 2 months ago

    Oh, border collie! I thought "Big Cock" and was confused. Why would you acronyze "border collie" when there isn't even any context that you're talking about a dog?

  • source
  • view more: next ›