all 16 comments

sorted by: hot top controversial new old
[–] 132 points 10 months ago (1 child)

Goddamn Dell of all companies is the only one that seems to get it. I'm shocked.

Welcome to the world outside of your own ass, Dell. The air is fresher out here.

  • source
  • hideshow 1 child comment
  • [–] 30 points 10 months ago

    Thank fucking God.

  • source
  • [–] 59 points 10 months ago* (2 children)

    The TPU is not for you, it’s for tech companies to surveil, train, and exfiltrate your data at every level of the stack from hardware to application in a “secure” fashion. The “features” they proscribe feel forced because they are - they exist to make it seem like you’re getting the next new thing, when really the features that you actually want (like an ad-free experience and a local Windows account) have been so enshitified to hell that they functionally no longer exist.

    • The hardware manufacturer gets to sell you extra hardware you don’t want.

    • The OS vendor gets to run classification on all of your pictures, documents, and software.

    • The browser vendor gets to see every site you visit and when, every product you buy, and every porn site you watch.

    • Then, it all gets trained into a personal model that is cryptographically tied to your hardware and identity that can be queried at any time by tech companies, data brokers, advertisers, and law enforcement.

    What YOU get is to ask a finders-fee-biased chatbot which product to buy, maybe some shitty mental health care, and a sycophantic buddy to patronize your ego. AI is the ultimate surveillance and advertising device.

  • source
  • hideshow 2 child comments
  • [–] 16 points 10 months ago

    Yeah, any AI with that much visibility into my life needs to be a locally run and personally controlled AI.

    But frankly as much as I might like that for myself, I don't want it because then it'll be baked into work computers with the same set of circumstances except now you have to placate an AI for career advancement.

    On the other hand, I just had an amazing idea for a n AI-powered USB device which emulates a keyboard but just does random SRS BIZNESS tasks like 16 hours a day. It'll find articles on the internet and graph all the numbers (even page numbers) in a spreadsheet. It'll create PowerPoints out of YouTube videos. It'll draft marketing materials and email them to random internet addresses. You'll be president of the company by the end of the month if AI has anything to say about it!

  • source
  • parent
  • [–] 20 points 10 months ago

    And so it begins?

  • source
  • [–] 18 points 10 months ago
    [–] 12 points 10 months ago

    Enterprise has spoken

  • source
  • [+] 10 points 10 months ago* (last edited 10 months ago) (1 child)
  • [–] 5 points 10 months ago

    These AI PCs/Notebooks aren't even able to run the really big models. For those you'd need a 5000$ card. And for the smaller models a good graphics card is often enough.

    For a real AI PC we would need new technology or graphics cards with more ram (the last one would suprise me with current ram prices)

  • source
  • [–] 4 points 10 months ago

    Almost nobody takes advantage of all the AI features they offer, Dell realized this

  • source
  • [–] 1 point 10 months ago (2 children)

    Do NPUs/TPUs even work with ComfyUI? That's the only "AI PC" I'm interested in.

  • source
  • hideshow 2 child comments
  • [–] 2 points 10 months ago

    The support is bad for custom nodes and NPUs are fairly slow compared to GPUs (expect 5x to 10x longer generation time compared to 30xx+ GPUs in best case scenarios) NPUs are good at running small models efficiently, not large LLM / Image models.

  • source
  • parent
  • 51 comments in c/technology@lemmy.zip view that post
    [–] 98 points 10 months ago (5 children)

    Honestly, that's pretty quick to learn that lesson. Huge corporations usually take way longer to figure that sort of thing out. Usually not until it's too late.

  • source
  • hideshow 5 child comments
  • [–] 30 points 10 months ago (3 children)

    I would speculate it means they either run on thinner margins than the companies that are all-in on AI, or they have less money available to throw around in the equipment hoarding wars. Or who knows, maybe someone with actual sense is heading the part of the company in charge of that decision. But I find the first two more likely.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 37 points 10 months ago (1 child)

    It's also very likely that they have a significant amount of corporate customers actively saying they won't purchase AI-oriented hardware for security reasons, so they're trying to spin the consumer angle publicly to try and grab the holdouts everyone else is obviously abandoning/ignoring as a side effect. That may be giving them too much credit, but despite just being okay at just about everything, they're still one of the large OEMs that has survived.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 16 points 10 months ago

    This also makes sense. Dell is massive in the dataceneters. As a consultant I've worked with Dell hardware far more than anything else. I will say, just about every customer I've worked with is interested in AI, but they want to run their own models, not some half baked thing from Dell.

  • source
  • parent
  • [–] 12 points 10 months ago

    The were also the ones to pioneer what I think was called “JIT2” or something like that. Basically it was a “just in time” scenario where they only kept 2 hours worth of parts at the factory. They would literally have trucks of parts lined up in the parking lot to unload for that days build. It shaved a massive amount of debt off as they wouldn’t have to stockpile parts and could change much more rapidly. That’s probably what’s allowing them to pivot in this case.

  • source
  • parent
  • [–] 42 points 10 months ago (23 children)

    WTF even is an "AI PC"? I saw an ad for some AI laptop. To my knowledge, nobody is running LLMs on their personal hardware, so do these computers have like...a web browser?

  • source
  • hideshow 23 child comments
  • [–] 13 points 10 months ago* (last edited 10 months ago) (1 child)

    You can run it on your laptop, I've tried it before (PS e.g. https://www.nomic.ai/gpt4all, it's fun to dig through your documents, but it wasn't as useful as I thought it would be in collecting ideas), what is truly hard is to train. But yeah, what is an AI PC? Is it like a gaming rig with lotsa RAM and GPU(s)?

  • source
  • parent
  • hideshow 1 child comment
  • [–] 10 points 10 months ago (5 children)

    Computers now come with a NPU (Neural Process Unit) to do that job... So yeah.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 9 points 10 months ago (4 children)

    What kind of consumer-facing software runs on that NPU?

  • source
  • parent
  • hideshow 4 child comments
  • [–] 9 points 10 months ago

    For what it’s worth an NPU is why your phone could tell you that photo is of a cat years before LLMs were the hot new thing. They were originally marketed as accelerators for machine learning applications before everybody started calling that AI.

  • source
  • parent
  • [–] 19 points 10 months ago (5 children)

    To my knowledge, nobody is running LLMs on their personal hardware

    They absolutely are.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 14 points 10 months ago (4 children)

    Statistically relevant portion?

    You know they were hyperbolic.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 1 point 10 months ago (3 children)

    "To my knowledge" really doesn't feel like hyperbole at all, IMO

  • source
  • parent
  • hideshow 3 child comments
  • [–] 5 points 10 months ago (2 children)

    Do 5% of people you know use local LLMs?

    If so, you don't know a lot of people, or you are heavy into the lLLM scene.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 3 points 10 months ago (1 child)

    Do 5% of people you know watch hockey regularly? If not, I guess it must not be a real sport, and that definitely has absolutely nothing to do with your own bubble

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 10 months ago

    Surprisingly a lot of people around me watch hockey.

    And I also hear about a lot of people watching it.

    But even though I'm very much into IT, I know very few people who selfhost. Despite that being a small community, local genAI seems even smaller that that.

  • source
  • parent
  • [–] 8 points 10 months ago

    Running an LLM locally is entirely possible with fairly decent modern hardware. You just won't be running the largest versions of the models. You're going to run ones intended for local use, almost certainly Quantized versions. Those usually are intended to cover 90% of use cases. Most people aren't really doing super complicated shit with these advanced models. They're asking it the same questions they typed into Google before, just using phrasing they used 20+ years ago with Ask Jeeves.

  • source
  • parent
  • [–] 11 points 10 months ago (4 children)

    Lots of people are. Typically it means they have an NPU.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 5 points 10 months ago (3 children)

    I'm talking about an ad I saw on broadcast television during a football game. I don't think the broad market of people are downloading models from huggingface or whatever.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 10 months ago (2 children)

    The ad you saw said no one was running local AI?

  • source
  • parent
  • hideshow 2 child comments
  • [–] 5 points 10 months ago (1 child)

    The ad was people doing generic AI stuff. I think it was even showing Copilot.

    Either way, the marketing for AI is far to nebulous for it to matter. Just looking for the ad, I found plenty (like this one) that explicitly mention "on-device AI," but show people just searching for shit or doing nebulous office work. This ad even shows generating images in MS Paint which offloads the AI shit to the cloud.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 19 points 10 months ago (2 children)

    “We’re very focused on delivering upon the AI capabilities of a device—in fact everything that we’re announcing has an NPU in it — but what we’ve learned over the course of this year, especially from a consumer perspective, is they’re not buying based on AI,” admits Kevin Terwilliger, Dell’s head of product, in the PC Gamer interview. “In fact I think AI probably confuses them more than it helps them understand a specific outcome.”

    They're just going to try to market it a little differently

  • source
  • hideshow 2 child comments
  • [–] 13 points 10 months ago (2 children)

    I care about AI PCs in that I actively do not want one. It's not that I'm indifferent.

    I'm looking for an android smart watch and I'm annoyed at how many come with interactive AI, which I also do not want.

  • source
  • hideshow 2 child comments
  • [–] 13 points 10 months ago (4 children)

    Whoever is making the decisions at Dell just made a very wise one. I’d expect IBM to be the most pragmatic but maybe I missed the news about them

  • source
  • hideshow 4 child comments
  • [+] 19 points 10 months ago* (3 children)
  • [–] 7 points 10 months ago

    Yes, it's useful for things like text to speech that doesn't sound like a Speak & Spell or motion detection that doesn't go off because a bug flew past the camera. I consider stuff like LLMs that will lie to me useless though.

  • source
  • parent
  • [–] 1 point 10 months ago

    I like sex.

    I don't like companies forcing sex on me so they can collect data to sell ads.

    When the discussions about AI are about the latter, I'm just going to say I don't like it without needing to clarify.

  • source
  • parent
  • [–] 5 points 10 months ago (1 child)

    The last time my wife bought a Dell PC, she became an Apple customer. She wanted to avoid the Apple tax but ended up dealing with bloatware, crashes, a slow PC and their horrible customer service.

  • source
  • hideshow 1 child comment
  • [–] 4 points 10 months ago

    I've bought multiple dell PCs for my business. No issues from any. The only annoying bloat is windows. That's not to say there ain't bloat, but it's nothing compared to windows, which is on every other commercial computer availabke for business.

  • source
  • parent
  • [–] 4 points 10 months ago*

    Its not that I don't care, its that they are too expensive & the monopolies want to exert control over the market. I considered buying a Ryzen AI Max+ 395. They actually had some okay deals for a bit, but they are still pretty inferior to GPU-accelerated solutions which are completely overpriced. Much of this was intentional, although RAM has recently seen more demand than supply. For a long time though, they were restricting the hardware & VRAM in GPUs though not because of price, but because it would take away from much of the dominance cloud-AI providers had, and also do so at the peril of them no longer being able to read & spy on your every conversation.

    That is why IMO the US will lose the AI-race. Not because we don't have smart people, but because capitalism is anti-innovation.

  • source
  • [–] 3 points 10 months ago

    well ig DELL is joining the corporation pack that dislikes
    AI or criticize it:
    IIRC: its Valve and Dreamworks that do it
    and now its DELL with both

  • source
  • [–] 3 points 10 months ago

    We don't care about dell anymore either. They have reduced the quality and standardization of their offerings to the point they are worse than just about any other 'brand'.

  • source
  • [–] 6 points 10 months ago

    I like ai. For real. When I want to go there and use it. I open the browser, type to Gemini and use it. Hate it when it is all over everything, especially where you don't need an AI. Glad they got it 

  • source