you are viewing a single comment's thread
view the rest of the comments
[–] 129 points 1 year ago (89 children)

It's funny how people always quickly point out that an LLM wasn't made for this, and then continue to shill it for use cases it wasn't made for either (The "intelligence" part of AI, for starters)

  • source
  • hideshow 89 child comments
  • [–] 26 points 1 year ago (3 children)

    It's marketed like its AGI, so we should treat it like AGI to show that it isn't AGI. Lots of people buy the bullshit

  • source
  • parent
  • hideshow 3 child comments
  • load more comments (2 replies)
  • [–] 12 points 1 year ago (8 children)

    Maybe they should call it what it is

    Machine Learning algorithms from 1990 repackaged and sold to us by marketing teams.

  • source
  • parent
  • hideshow 8 child comments
  • [–] 4 points 1 year ago (3 children)

    Hey now, that's unfair and queerphobic.

    These models are from 1950, with juiced up data sets. Alan turing personally sid a lot of work on them, before he cracked the math and figured out they were shit and would always be shit.

  • source
  • parent
  • hideshow 3 child comments
  • [–] a comment that isn't shown here: deleted, from someone you've blocked, or on another page. view the thread from it
  • [–] 4 points 1 year ago* (2 children)

    Adding weights doesn't make it a fundamentally different algorithm.

    We have hit a wall where these programs have combed over the totality of the internet and all available datasets and texts in existence.

    There isn't any more training data to improve with, and these programs have stated polluting the internet with bad data that will make them even dumber and incorrect in the long run.

    We're done here until there's a fundamentally new approach that isn't repetitive training.

  • source
  • parent
  • hideshow 2 child comments
  • load more comments (2 replies)
  • load more comments (1 reply)
  • [+] 42 points 1 year ago* (57 children)
  • [–] a comment that isn't shown here: deleted, from someone you've blocked, or on another page. view the thread from it
  • [–] 7 points 1 year ago (5 children)

    You might just love Blind Sight. Here, they're trying to decide if an alien life form is sentient or a Chinese Room:

    "Tell me more about your cousins," Rorschach sent.

    "Our cousins lie about the family tree," Sascha replied, "with nieces and nephews and Neandertals. We do not like annoying cousins."

    "We'd like to know about this tree."

    Sascha muted the channel and gave us a look that said Could it be any more obvious? "It couldn't have parsed that. There were three linguistic ambiguities in there. It just ignored them."

    "Well, it asked for clarification," Bates pointed out.

    "It asked a follow-up question. Different thing entirely."

    Bates was still out of the loop. Szpindel was starting to get it, though.. .

  • source
  • parent
  • hideshow 5 child comments
  • [–] 6 points 1 year ago* (4 children)

    Blindsight is such a great novel. It has not one, not two but three great sci-fi concepts rolled into one book.

    One is artificial intelligence (the ship's captain is an AI), the second is alien life so vastly different it appears incomprehensible to human minds. And last but not least, and the most wild, vampires as a evolutionary branch of humanity that died out and has been recreated in the future.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 4 points 1 year ago* (last edited 1 year ago) (2 children)

    Also, the extremely post-cyberpunk posthumans, and each member of the crew is a different extremely capable kind of fucked up model of what we might become, with the protagonist personifying the genre of horror that it is, while still being occasionally hilarious.

    Despite being fundamentally a cosmic horror novel, and relentlessly math-in-the-back-of-the-book hard scifi it does what all the best cyberpunk does and shamelessly flirts with the supernatural at every opportunity. The sequel doubles down on this, and while not quite as good overall (still exceptionally good, but harder to follow) each of the characters explores a novel and sweet+sad+horrifying kind of love.

  • source
  • parent
  • hideshow 2 child comments
  • [–] a comment that isn't shown here: deleted, from someone you've blocked, or on another page. view the thread from it
  • Characters in the sequel include a hive-mind of post-science innovation monks, a straight up witch who charges their monastery at the head of a zombie army, and a plotline about finding what the monks think might be god. And that first scene, which is absolute fire btw.

    Primary themes include... Well the bit of exposition about needing to 'crawl off one mountain and cross a valley to reach higher peaks of understanding', and coping as a mostly baseline human surrounded by superintelligences, 'sufficiently advanced technology', etc.

  • source
  • parent
  • load more comments (1 reply)
  • [–] 4 points 1 year ago

    My a favorite part of the vampire thing is how they died out. Turns out vampires start seizing when trying to visually process 90Β° angles, and humans love building shit like that (not to mention a cross is littered with them). It's so mundane an extinction I'd almost believe it.

  • source
  • parent
  • [–] 10 points 1 year ago (24 children)

    You've missed something about the Chinese Room. The solution to the Chinese Room riddle is that it is not the person in the room but rather the room itself that is communicating with you. The fact that there's a person there is irrelevant, and they could be replaced with a speaker or computer terminal.

    Put differently, it's not an indictment of LLMs that they are merely Chinese Rooms, but rather one should be impressed that the Chinese Room is so capable despite being a completely deterministic machine.

    If one day we discover that the human brain works on much simpler principles than we once thought, would that make humans any less valuable? It should be deeply troubling to us that LLMs can do so much while the mathematics behind them are so simple. Arguments that because LLMs are just scaled-up autocomplete they surely can't be very good at anything are not comforting to me at all.

  • source
  • parent
  • hideshow 24 child comments
  • [–] a comment that isn't shown here: deleted, from someone you've blocked, or on another page. view the thread from it
  • [–] 1 point 1 year ago* (2 children)

    Because LLMs operate at the token level, I think it would be a more fair comparison with humans to ask why humans can't produce the IPA spelling words they can say, /nΙ”r kΓ¦n Γ°eΙͺ ˈizΙ™li rid ΞΈΙͺΕ‹z ˈrΙͺtΙ™n ˈpjʊrli Ιͺn aΙͺ pi ˈeΙͺ/ despite the fact that it should be simple to -- they understand the sounds after all. I'd be impressed if somebody could do this too! But that most people can't shouldn't really move you to think humans must be fundamentally stupid because of this one curious artifact. Maybe they are fundamentall stupid for other reasons, but this one thing is quite unrelated.

  • source
  • parent
  • hideshow 2 child comments
  • [+] 1 point 1 year ago (2 children)
  • [–] 1 point 1 year ago* (1 child)

    I mean, among people who are proficient with IPA, they still struggle to read whole sentences written entirely in IPA. Similarly, people who speak and read chinese struggle to read entire sentences written in pinyin. I'm not saying people can't do it, just that it's much less natural for us (even though it doesn't really seem like it ought to be.)

    I agree that LLMs are not as bright as they look, but my point here is that this particular thing -- their strange inconsistency understanding what letters correspond to the tokens they produce -- specifically shouldn't be taken as evidence for or against LLMs being capable in any other context.

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (-1 replies)
  • [–] a comment that isn't shown here: deleted, from someone you've blocked, or on another page. view the thread from it
  • [–] 1 point 1 year ago (4 children)

    You're right, I shouldn't have called it a riddle. Still, being a fucking thought experiment doesn't preclude having a solution. Theseus' ship is another famous fucking thought experiment, which has also been solved.

  • source
  • parent
  • hideshow 4 child comments
  • [–] a comment that isn't shown here: deleted, from someone you've blocked, or on another page. view the thread from it
  • [–] 1 point 1 year ago (2 children)

    I suppose if you're going to be postmodernist about it, but that's beyond my ability to understand. The only complete solution I know to Theseus' Ship is "the universe is agnostic as to which ship is the original. Identity of a composite thing is not part of the laws of physics." Not sure why you put scare quotes around it.

  • source
  • parent
  • hideshow 2 child comments
  • load more comments (1 reply)
  • [–] a comment that isn't shown here: deleted, from someone you've blocked, or on another page. view the thread from it
  • [–] 1 point 1 year ago (12 children)

    Why doesn't the LLM know to write (and run) a program to calculate the number of characters?

    I feel like I'm missing something fundamental.

  • source
  • parent
  • hideshow 12 child comments
  • [–] 1 point 1 year ago* (3 children)

    It doesn't know things.

    It's a statistical model. It cannot synthesize information or problem solve, only show you a rough average of it's library of inputs graphed by proximity to your input.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 1 year ago (2 children)

    Congrats, you've discovered reductionism. The human brain also doesn't know things, as it's composed of electrical synapses made of molecules that obey the laws of physics and direct one's mouth to make words in response to signals that come from the ears.

    Not saying LLMs don't know things, but your argument as to why they don't know things has no merit.

  • source
  • parent
  • hideshow 2 child comments
  • load more comments (1 reply)
  • [–] 1 point 1 year ago* (4 children)

    The LLM isn't aware of its own limitations in this regard. The specific problem of getting an LLM to know what characters a token comprises has not been the focus of training. It's a totally different kind of error than other hallucinations, it's almost entirely orthogonal, but other hallucinations are much more important to solve, whereas being able to count the number of letters in a word or add numbers together is not very important, since as you point out, there are already programs that can do that.

    At the moment, you can compare this perhaps to the Paris in the the Spring illusion. Why don't people know to double-check the number of 'the's in a sentence? They could just use their fingers to block out adjacent words and read each word in isolation. They must be idiots and we shouldn't trust humans in any domain.

  • source
  • parent
  • hideshow 4 child comments
  • [–] a comment that isn't shown here: deleted, from someone you've blocked, or on another page. view the thread from it
  • [–] 1 point 1 year ago (2 children)

    This might well be true yeah. But that's still good news for AI companies who want to replace humans -- bar's lower than they thought.

  • source
  • parent
  • hideshow 2 child comments
  • load more comments (1 reply)
  • load more comments (1 reply)
  • [–] 2 points 1 year ago (2 children)

    You didn't get good answers so I'll explain.

    First, an LLM can easily write a program to calculate the number of rs. If you ask an LLM to do this, you will get the code back.

    But the website ChatGPT.com has no way of executing this code, even if it was generated.

    The second explanation is how LLMs work. They work on the word (technically token, but think word) level. They don't see letters. The AI behind it literally can only see words. The way it generates output is it starts typing words, and then guesses what word is most likely to come next. So it literally does not know how many rs are in strawberry. The impressive part is how good this "guessing what word comes next" is at answering more complex questions.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 1 year ago (1 child)

    But why can't "query the python terminal" be trained into the LLM. It just needs some UI training.

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (3 replies)
  • That's a very long answer to my snarky little comment :) I appreciate it though. Personally, I find LLMs interesting and I've spent quite a while playing with them. But after all they are like you described, an interconnected catalogue of random stuff, with some hallucinations to fill the gaps. They are NOT a reliable source of information or general knowledge or even safe to use as an "assistant". The marketing of LLMs as being fit for such purposes is the problem. Humans tend to turn off their brains and to blindly trust technology, and the tech companies are encouraging them to do so by making false promises.

  • source
  • parent
  • [–] 3 points 1 year ago (8 children)

    a much simpler and dumber machine that was designed to handle this basic input question could have come up with the answer faster and more accurately

    The human approach could be to write a (python) program to count the number of characters precisely.

    When people refer to agents, is this what they are supposed to be doing? Is it done in a generic fashion or will it fall over with complexity?

  • source
  • parent
  • hideshow 8 child comments
  • [–] a comment that isn't shown here: deleted, from someone you've blocked, or on another page. view the thread from it
  • [–] 1 point 1 year ago (1 child)

    'agents' just interact with other programs.

    If that other program is, say, a python terminal then can't LLMs be trained to use agents to solve problems outside their area of expertise?

    I just tested chatgpt to write a python program to return the frequency of letters in a string, then asked it for the number of L's in the longest placename in Europe.

    ''''

    String to analyze

    text = "Llanfairpwllgwyngyllgogerychwyrndrobwllllantysiliogogogoch"

    Convert to lowercase to count both 'L' and 'l' as the same

    text = text.lower()

    Dictionary to store character frequencies

    frequency = {}

    Count characters

    for char in text: if char in frequency: frequency[char] += 1 else: frequency[char] = 1

    Show the number of 'l's

    print("Number of 'l's:", frequency.get('l', 0))

    '''

    I was impressed until

    Output

    Number of 'l's: 16

  • source
  • parent
  • hideshow 1 child comment
  • [–] a comment that isn't shown here: deleted, from someone you've blocked, or on another page. view the thread from it
  • [–] 1 point 1 year ago

    in what context? LLMs are extremely good at bridging from natural language to API calls. I dare say it's one of the few use cases that have decisively landed on "yes, this is something LLMs are actually good at." Maybe not five nines of reliability, but language itself doesn't have five nines of reliability.

  • source
  • parent
  • [–] a comment that isn't shown here: deleted, from someone you've blocked, or on another page. view the thread from it
  • [–] 1 point 1 year ago

    The claim is not that all LLMs are agents, but rather that agents (which incorporate an LLM as one of their key components) are more powerful than an LLM on its own.

    We don't know how far away we are from recursive self-improvement. We might already be there to be honest; how much of the job of an LLM researcher can already be automated? It's unclear if there's some ceiling to what a recursively-improved GPT4.x-w/e can do though; maybe there's a key hypothesis it will never formulate on the quest for self-improvement.

  • source
  • parent
  • load more comments (4 replies)
  • [–] a comment that isn't shown here: deleted, from someone you've blocked, or on another page. view the thread from it
  • [–] 2 points 1 year ago

    Yes that's right, LLMs are context-free. They don't have internal state. When I say "update on new information" I really mean "when new information is available in its context window, its response takes that into account."

  • source
  • parent
  • load more comments (10 replies)
  • [–] 11 points 1 year ago (2 children)

    then continue to shill it for use cases it wasn't made for either

    The only thing it was made for is "spicy autocomplete".

  • source
  • parent
  • hideshow 2 child comments
  • [–] 18 points 1 year ago (14 children)

    There are different types of Artificial intelligences. Counter-Strike 1.6 bots, by definition, were AI. They even used deep learning to figure out new maps.

  • source
  • parent
  • hideshow 14 child comments
  • [–] a comment that isn't shown here: deleted, from someone you've blocked, or on another page. view the thread from it
  • [–] 3 points 1 year ago (12 children)

    By this logic any solid state machine is AI.

    These words used to mean things before marketing teams started calling everything they want to sell "AI"

  • source
  • parent
  • hideshow 12 child comments
  • load more comments (10 replies)
  • load more comments (1 reply)