[–] 7 points 5 months ago

“Significant productivity in the economy is going to raise the standard of living,” he said. “People who today have two-earner households, they’ll become one-earner households. Maybe some people who are working overtime will stop working overtime.”

I fucking love it when the exact people who make it their life's mission not to pay their employees living wages so that they can hoard wealth like an evil dragon come out and tell us that the new tech they are using to replace us will make us rich. Really fucking Jeff? How about we eat you and take it? That's the only way I see it happening.

  • source
  • [–] [S] 1 point 6 months ago

    For sure, it's pretty magical, and I feel like this year has been a real breakthrough for local models where they really can do non-trivial work. I'm really excited to see what things look like by next year.

  • source
  • parent
  • context
  • [–] 1 point 6 months ago (1 child)

    Agreed! It really is neat to be present and participating during this time. I know the future will hold great things but it's crazy how quickly things move, to your point.

    I know there will be some demand for turnkey AI solutions as people not like us won't have the time or patience (or hardware) to make it work, but it's so rewarding when it does work.

    And boy does it work!

  • source
  • parent
  • context
  • [–] [S] 1 point 6 months ago (2 children)

    I find it absolutely incredible that just within a few years we went from need a data centre to running this stuff on a laptop. And there are still a whole bunch of papers that have come out in just past few months that haven't even been adopted yet. Like the whole MTP thing itself is completely new, and we see some new breakthrough like it happening every few months.

    I really think the whole AI as a service business model is dead in the water at this point. I'm sure there's going to be some market for it, but running models locally is just a superior experience in most cases. You get to keep your data on your machine, you don't have to worry about the provider changing things from under you, or your costs changing. Once it works, it's predictable and you own it.

  • source
  • parent
  • context
  • [–] 2 points 6 months ago (3 children)

    I finally got lm studio working with my local setup (after their 0.4.14 beta release and llama.cpp beta update)

    I'm using Claudish as an interface from Claude Code and VS Studio to LM Studio, along with qwen 3.6 35B MTP on my 7900xtx.

    Here is what Gemini had to say evaluating my performance numbers -

    The Ultimate Takeaway

    ​You have built a local architecture that rivals a multi-billion dollar cloud infrastructure for day-to-day development. The fact that you have a 35B model executing with a 72.1% MTP acceptance rate means your hardware is perfectly tuned to the way code is written.

  • source
  • [–] [S] 1 point 6 months ago (1 child)

    I find it's the first model I can run locally that actually feels genuinely useful for coding. I'm really excited about what things might look like in another year. We might really get current frontier model performance on a laptop at this rate.

  • source
  • parent
  • context
  • [–] [S] 2 points 6 months ago

    Oh yeah, that's definitely the best approach if you don't already have the hardware since DeepSeek is just absurdly cheap to use. Eventually, hardware prices are going to come down, and local models are going to keep getting more efficient too. So, dumping a few grand on a rig right now doesn't really make much sense.

  • source
  • parent
  • context
  • [–] 1 point 6 months ago (1 child)

    Thanks. I haven’t bought hardware to run things locally yet. I did buy some DeepSeek tokens this weekend to play around with. Maybe I should rent until the bubble pops and then buy a supercomputer at fire sale prices.

  • source
  • parent
  • context
  • [–] 1 point 6 months ago

    It's really instructive to see how China is applying AI in pragmatic and utilitarian ways while US companies are chasing the whole AGI unicorn. I also suspect there's a big difference stemming from the fact that China has a massive industrial base which create a lot of niches for automation that simply don't exist in the US. So, there's much more focus on robotics, infrastructure monitoring, factory work, and so on.

  • source
  • [–] 2 points 6 months ago

    Is this even untrustworthy? I haven’t looked into what Sam and his company say very much, but I for sure trusted that the hallucinating plagiarism machine that has the ability to cross so, so many different coding boundaries would definitely at least leak anything I have to it, and at worst actively use it sell it save it propagate it.

  • source
  • parent
  • context
  • view more: ‹ prev next ›