you are viewing a single comment's thread
view the rest of the comments
[–] -1 points 2 months ago (5 children)

Neither can an LLM. Try asking ChatGPT to run a matrix cross-multiplication, it sucks as badly as if you tried to do it without any paper.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 2 points 2 months ago (4 children)

    An LLM can't read the matrix in which it stores its own parameters?

    That's like saying a human can't read the neurons in their own brain. Sure, looking at them through a microscope, we can not.

    You don't seem to have any idea what you're talking about.

  • source
  • parent
  • hideshow 4 child comments
  • [–] -1 points 2 months ago (3 children)

    That’s like saying a human can’t read the neurons in their own brain

    Yeah, that's what you just said. Matrix multiplication is an abstract representation of neuron weights, remember? And then you said a human can't read the matrix. Like it was at all relevant. Obviously neither humans nor LLMs can understand the individual neurons that make up their thoughts, nor the matrices that describe those neurons. Obviously.

    Are you ready to stop regurgitating canned arguments yet?

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 2 months ago (2 children)

    LOL.

    We're discussing whether LLMs can think and have intuition.

    My point is, just because we can't read the probability matrix with which they formulate their answers, does not mean they have intuition.

  • source
  • parent
  • hideshow 2 child comments
  • [–] -1 points 2 months ago* (1 child)

    There is no "probability matrix". There's an input matrix (which you provide it), various neuron weight matrices, and an output matrix (which contains the thing it says in response to your input).

    It doesn't look up a table of things to say like a d100 table in an RPG. You've fundamentally misunderstood the technology.

    It's not a magic 8 ball.

  • source
  • parent
  • hideshow 1 child comment