top 13 comments

sorted by: hot top controversial new old
[–] 53 points 1 year ago (2 children)

Gotta remember that AI isn't occasionally hallucinating and often recalling information, it's never recalling information, it's always hallucinating, just that we say we like some of the hallucinations, so it does those more often.

  • source
  • hideshow 2 child comments
  • [–] 9 points 1 year ago

    Well, not sure what you mean by hallucinating, but there are some LLMs (chatgpt3.5-turbo-instruct) that could play chess at a good amateur level (1750 elo), and by studying them, some people found parameters in the model that seemed to represent the current state of the chess board (as in, they corresponded to the game, and changing them artificially made the LLM play as if the game as always been that way).

  • source
  • parent
  • [–] 28 points 1 year ago (1 child)

    This is incredible. They've finally made an AI as good at chess as me.

  • source
  • hideshow 1 child comment
  • load more comments (1 reply)
    [–] 8 points 1 year ago

    TIL that I play chess like an AI model.

  • source
  • [–] 7 points 1 year ago*

    A screwdriver beat a hammer in a screw driving competition. well done.

    Maybe it sounds impressive when hammers are super hyped and everyone and their mother is driving their screws with them, but it honestly really isn't.

  • source
  • [–] 7 points 1 year ago (4 children)

    What’s ChatGPT’s rating? It’s impressive it can play chess at all, considering that’s not its core skill.

  • source
  • hideshow 4 child comments
  • [–] [S] 4 points 1 year ago (3 children)

    I wouldn't be surprised if it's literally zero. I've tried with a few LLMs, and they're all very confident that they know how to play chess, but they just start hallucinating illegal moves immediately.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 1 year ago (2 children)

    Immediately? When was the last time you tried? The newer models can hold a game well for 10-20 moves.

  • source
  • parent
  • hideshow 2 child comments
  • [–] [S] 1 point 1 year ago (1 child)

    A few weeks ago, Gemini got confused when it tried to go first as black multiple times, so that's the most immediate one I can remember. Last week, chatGPT offered to set up chess puzzles for me, but it made mistakes 3 out of 3 times.

    Maybe I'll try again. Is there a certain one you've seen good performance out of?

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 1 year ago

    DeepSeek is very consistent ime. ChatGPT is hit or miss--sometimes it's excellent, sometimes it gets really confused and says random stuff. Though DeepSeek has a server reliability problem.

  • source
  • parent
  • [–] 5 points 1 year ago

    Quick! Stop it before it takes over the world!

  • source
  • [–] 3 points 1 year ago

    To be fair the Atari was built to play games. /s

    But for real wasn't AI supposed to be bare minimum good at this game. Is this not how were to train them in order to know if they are intelligent or not?

  • source