"AI is so complex even the developers dont understand it" "looks inside" "if-statement and for-loops" cat stares down at the camera

all 40 comments

sorted by: hot top controversial new old
[–] 173 points 1 month ago (9 children)

More accurately:
>looks inside
>matrix multiplication

  • source
  • hideshow 9 child comments
  • [–] 13 points 1 month ago

    Had one guy asking if AI is conscious. I said the whole thing is actually one very big excel sheet, so does he think that excel can be conscious? Anyway, I think the guy is now in a relationship with office.

  • source
  • parent
  • [–] 10 points 1 month ago (2 children)

    Matrix multiplication, activation functions and softmax. Also some matrix addition sometimes. That's literally it

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 1 month ago* (last edited 1 month ago)

    I mean yeah, the mechanism itself is straightforward, but isn't a big thing that we don't really know what it chooses for its... basis vectors? Something like that, I don't do programming and I'm out of practice with matrices

  • source
  • parent
  • [–] [S] 13 points 1 month ago (4 children)

    Yes, it is inherently incorrect, I just think that increases the fun factor. It reminds me of that guy who wrote a prime-checker for his thesis and it was just a massive list of if-statement

  • source
  • parent
  • hideshow 4 child comments
  • [–] 5 points 1 month ago (2 children)

    A transistor is on or off. It's all if-then.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 64 points 1 month ago (1 child)

    You don't have to be an AI developer to not understand your code. I not understand my code every day.

  • source
  • hideshow 1 child comment
  • [–] 54 points 1 month ago (2 children)

    It’s just y = k*x + m a few trillion times.

  • source
  • hideshow 2 child comments
  • [–] 110 points 1 month ago (6 children)

    The human brain is far too complex to understand

    looks inside

    it's just meat

  • source
  • hideshow 6 child comments
  • [–] 57 points 1 month ago (2 children)

    The brain isn't meat, it's fat, and is known to turn to soap under the right conditions. Which coincidentally also explains the soapy tiddy memes.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 70 points 1 month ago (5 children)

    That was old AI.

    New AI uses a complex, multi-layer sequence of Magic 8-balls.

  • source
  • hideshow 5 child comments
  • [–] [S] 1 point 1 month ago

    I would be heavily more inclined to use LLMs (and also probably use it in a more correct manner) if it came in the physical form of a magic 8-ball that I would violently shake to get the answer.

  • source
  • parent
  • [–] 29 points 1 month ago

    come on, it’s not that simple!

    there’s also linear algebra

  • source
  • [–] 56 points 1 month ago
    [–] 26 points 1 month ago* (3 children)

    Have you ever tried to follow five hundred nested for loop and if statements? Shit is nuts...

  • source
  • hideshow 3 child comments
  • [–] 15 points 1 month ago (1 child)

    Oh, just wait till you hit that sweet sweet python "Everything can have an else block"

    if some_shit:
        try: 
            for stuff in thing:
                 if stuff is bad:
                      raise ShitHitTheFanError
                 # Massive block comment
                 do = the_thing()
                 if do is good:
                      break
            else:
                do = the_other_thing()
                if not a_thing:
                    help_me() # May raise NoHelpFoundError
        except ShitHitTheFanError:
             my_life = recover()
             if my_life is bad:
                 for fuck in my_life:
                      try:
                          fix(fuck)
                      except NoHelpFoundError:
                          break
                 else:
                      fuck_this_shit()
        else:
             wat_is_going_on()
    else:
        theres_another_one("?")
    
  • source
  • parent
  • hideshow 1 child comment
  • [–] 9 points 1 month ago (2 children)

    If statements are some of the largest sources of bugs in software.

  • source
  • hideshow 2 child comments
  • [–] 4 points 1 month ago

    ml is not a hard coded set of if-else pairs. it's a glorified fit with a lot of parameters.

  • source
  • [–] 1 point 1 month ago

    Indeed! See: induction circuits

  • source
  • [–] 1 point 1 month ago

    repeat that for like one hundred billion times and now THAT's innovation

  • source
  • 24 comments in c/programmer_humor@programming.dev view that post
    [–] 34 points 1 month ago (2 children)

    And the human brain is just fatty tissue and neurons.

  • source
  • hideshow 2 child comments
  • [–] 16 points 1 month ago*

    Ha, in fact it's all GOTO jumps like on a trampoline.

  • source
  • [–] 24 points 1 month ago (12 children)

    Cool; walk me through attention layers plz.

  • source
  • hideshow 12 child comments
  • [–] 25 points 1 month ago (7 children)

    Yeah. It's some if statements and some loops but with CUDA and matrix multiplication

  • source
  • parent
  • hideshow 7 child comments
  • [–] 12 points 1 month ago (6 children)

    Great; that describes all functions, so we've nothing to worry about.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 23 points 1 month ago (5 children)

    No no we still gotta worry about people in power allowing the worst possible use of technology at everyone's expense for personal gain..

    So same old

  • source
  • parent
  • hideshow 5 child comments
  • [+] -12 points 1 month ago (4 children)

    What specifically do you want the people in power to do?

  • source
  • parent
  • hideshow 4 child comments
  • [–] 17 points 1 month ago (2 children)

    A very good start would be people not having that much power to begin with. Especially not if they’re not democratically elected representatives.

    But for the people in power we’re seemingly talking about (AI company leaders):

    • Not presenting AI as something mystical/mythical
    • Not turning AI into a product tailored to be addictive
    • Not framing AI as a tech only they can be trusted to keep and distribute (see also point 1)
    • Maybe developing the technology towards what gives most utility, not what earns them the most money (fat chance)
  • source
  • parent
  • hideshow 2 child comments
  • [–] 8 points 1 month ago (1 child)

    I just want these AI companies to be held accountable for openly trying to hack everyone. It's ridiculous they're allowed to hide behind "AI did it, not us" as if what their product does isn't their responsibility.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 1 month ago*

    Think of it as a game, the players are corpo, and gov.

    Corpo hacks planet, gov says, "Hm, that's pretty bad corpo, we could hold you accountable.. but.. that's pretty neat, maybe share a lil with us how you achieved this terrible incident (that we totally don't want to leverage against international peers) and we can forget this happened.."

    A game of incentives.

    If the gov comes down too hard, they could slow the development, the same development that they short-sightedly want to exploit in parallel with the accused.

  • source
  • parent
  • [–] 11 points 1 month ago* (1 child)
  • [–] 3 points 1 month ago

    GPT is basically a machine that builds machines.

    We understand how the machine builder works. We don't understand how the output of the machine works. Like mechanically we understand each individual sub-component works e.g. a single matrix multiplication, but we don't understand why specific weights are the value they are, or the broader macrostructure.

    I don't think you realize that acting like "No we actually do understand how it works" just reveals that you don't understand the question, it does not show that the question has an answer.

  • source
  • parent
  • [–] 12 points 1 month ago*

    It's just a series of 10 trillion floats. And we don't really know what the individual floats represent and changing them degrades performance but hey

    Technically. It's just if statements.

  • source
  • [–] 8 points 1 month ago

    It's all just NAND gates?

  • source
  • [–] 7 points 1 month ago

    "It's like Blade Runner, but we'll make sure the robots aren't the villains this time" -- some billionaire, probably

  • source
  • [–] 11 points 1 month ago* (last edited 1 month ago)

    not really it is mostly automatic gradients on billion parameters and shit loads of regularization.

  • source
  • [–] 5 points 1 month ago

    It's not really cold though is it. It's just a lot of numbers and those numbers somehow do things. Like it says no one understands it.

  • source
  • [–] 1 point 1 month ago

    It was better when it was just ifs and for loops and runs on potatoes and does actually useful things.

  • source