Microsoft has published an ad promoting Copilot on Windows 11, but it contains a hilarious error that actually proves how useless the AI is.

all 24 comments

sorted by: hot top controversial new old
[–] 56 points 1 year ago* (last edited 1 year ago) (1 child)

To anyone thinking this is "not such a big deal":

Consider this is one of the most valuable, influential companies on the planet. They're pushing Copilot like their bottom line depends on it.

Not only did Copilot give an objectively incorrect response - and bring into question the fundamental usefulness of the feature - I think what's being glossed over is: They published this.

For a company that's so desperate to push a clearly half-baked, unwanted feature - publishing an ad showing it malfunctioning is hilariously inept. It's not just a bad look for the product, it's an embarrassment for the company.

  • source
  • hideshow 1 child comment
  • [–] 28 points 1 year ago

    The article doesn't really mention it and only focuses on it providing an incorrect value (150% when it's already at 150%), but this bit that's added as a reader context to the Tweet is even bigger blunder:

    The user asked how to increase text size, but Copilot incorrectly advised changing the "Scale" option in Settings > System > Display. This enlarges text, but also resizes UI, apps, and other elements

    To change only text size, go to Settings > Accessibility > Text size.

  • source
  • [–] 55 points 1 year ago (12 children)

    …In the video, the influencer activates Copilot with the "Hey Copilot" voice activation and then asks it how they can increase the font size via Windows Settings. This is actually a pretty common scenario, especially when the elderly are interacting with tech hardware or when you connect your PC to an external monitor and the text is just too small to make out.

    Now, Copilot asks Aura to navigate to the Display settings in Windows and change the text scale to 150% which is the recommended option. The really funny part here is that the scaling is already set to 150%, so changing it wouldn't really make a difference. Apparently in order to work around this gaffe, Aura quickly manually sets the scale to 200%, which solves the problem but isn't what Copilot actually suggested…

  • source
  • hideshow 12 child comments
  • [+] -16 points 1 year ago (11 children)

    Aura quickly manually sets the scale to 200%, which solves the problem but isn't what Copilot actually suggested…

    Isn't that what almost anyone would do?

    I've seen some pretty silly AI blunders before, but this one seems rather harmless. You're still going to end up at the setting you need to change to solve the problem, which to me falls squarely in the "close enough" bin.

  • source
  • parent
  • hideshow 11 child comments
  • [–] 41 points 1 year ago (4 children)

    Copilot didn't suggest 150% in the context of a set of instructions. He specifically asked Copilot which percentage to set. That was the only task which Copilot was being asked to solve at that point in time.

    You might also say that this is a simple task, so nobody would actually ask Copilot what percentage to use but isn't that the point? This task, which Copilot failed on, is a simple task.

  • source
  • parent
  • hideshow 4 child comments
  • [–] -1 points 1 year ago (1 child)

    He specifically asked Copilot which percentage to set.

    Ah, I see. That's not at all clear from what the article says:

    In the video, the influencer activates Copilot with the "Hey Copilot" voice activation and then asks it how they can increase the font size via Windows Settings.

    Perhaps the original video has what you're talking about.

  • source
  • parent
  • hideshow 1 child comment
  • Yes, it does. It's only a short video but, anyway:

    He has already opened the drop-down, where 150% is currently selected. He asks "what percentage should I click?" and Copilot replies "let's start with 150%, which is the recommended size". He hesitates slightly, then says "let's...", clicks 200% and then says "boom!".

  • source
  • parent
  • [–] 9 points 1 year ago (5 children)

    the problem is two fold and this applies to all LLMs.

    1. according to the article the person asked HOW to increase the font size. Copilot then tells Aura to go increase the font size so it's not exactly what the person asked.

    2. like all LLMs it MUST provide a solution. it MUST do something. Copilot asks Aura to increase the font size to 150%. it's already at 150%. but instead of going back to the user and saying "the font size is already set to 150%, would you like to increase it more?" it just goes ahead and bumps it up to 200 because it has to. it has no choice, it must provide some kind of solution. LLMs like GPT5, Claude, etc will do similar crap which ultimately shows that recent models are all collectively garbage. they now must ALL provide some sort of solution even if the majority of the time said solutions are actually hallucinations. LLMs aren't allowed to say "I don't know" or "it's already done" or whatever.

    So this video/article just shows how pointless and unreliable LLMs/AI are at even the most basic things. They've all been told that they must provide some kind of solution, always. It's especially bad now with recent updates. Claude will hallucinate 8 times out of 10 for its solutions. GPT5 now just info dumps on you hoping something in there will resonate, it can't provide an accurate precise solution anymore it just vomits on your plate and calls it a meal.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 12 points 1 year ago (4 children)

    Hold up,

    [...] instead of going back to the user and saying "the font size is already set to 150%, would you like to increase it more?" it just goes ahead and bumps it up to 200 because it has to.

    No it did not. Copilot doesn't click or change anything in this video, that's the user clicking 200% after copilot told him to make it 150%.

    The only actual flaws here is Copilot not seeing the size was already set to 150%

  • source
  • parent
  • hideshow 4 child comments
  • [–] 2 points 1 year ago

    It seems like people are so eagre to bash AI that they're willing to invent their own narrative to shit on anyone who remotely sounds like they support it, even if that's not the case.

    I appreciate you actually taking the time and effort to read.

  • source
  • parent
  • [–] 27 points 1 year ago (1 child)

    Microsoft slop OS with slop 365 subscription for only $19/month.

  • source
  • hideshow 1 child comment
  • [–] 13 points 1 year ago

    I guess in order to have artificial intelligence you must first have genuine stupidity

  • source
  • [–] -3 points 1 year ago (4 children)

    Now, Copilot asks Aura to navigate to the Display settings in Windows and change the text scale to 150% which is the recommended option. The really funny part here is that the scaling is already set to 150%, so changing it wouldn't really make a difference. Apparently in order to work around this gaffe, Aura quickly manually sets the scale to 200%, which solves the problem but isn't what Copilot actually suggested

    Not gonna lie I was expecting something more substantial.

  • source
  • hideshow 4 child comments
  • [–] 14 points 1 year ago

    Yeah, but to be fair it is substantial enough. This is very basic support issue. Most users (I suspect) wouldn't need any help with this. Any user who does need help from Copilot to change the font size would probably be further confused. If Copilot cannot handle something this simple, how in the world can anyone expect it to be useful and accurate in more complicated situations?

  • source
  • parent
  • [–] 4 points 1 year ago (2 children)

    The article does not mention this, but it's also not a correct solution at all for increasing text size (which was what the guy was asking it how to do). From the reader context of the tweet:

    The user asked how to increase text size, but Copilot incorrectly advised changing the "Scale" option in Settings > System > Display. This enlarges text, but also resizes UI, apps, and other elements

    To change only text size, go to Settings > Accessibility > Text size.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 1 year ago (1 child)

    I'm not sure about that, I think what you're saying is technically right but when I hear someone say they want the text to be bigger on the computer they typically do want to scale everything up but lack the vocabulary to say that. It's impossible to know which they actually want without more context, but going for scaling isn't unreasonable.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 1 year ago

    Youre not the first comment that mentions this, and technically it's right. But the fundamental problem for me is that the AI had a well defined problem - it had one correct answer. Increase text size. It failed, and chose a solution to a problem that 'people who usualy have it, want this solution".

    It was just mediocre solution, that works for median of people.

    It didn't matter that you specified concrete problem you have - I want larger text. It just averaged it.

    Thats the problem with AI. If you want mediocre solution to a very common problem, it works.

    But thats the only way it works.

  • source
  • parent