top 12 comments

sorted by: hot top controversial new old
[–] 10 points 9 months ago

If we actually had superintelligent AI, I might be concerned. But what we have instead is stochastic parrots with no innate volition. In and of themselves, they aren't dangerous at all—it's the humans backing them that we have to be wary of.

  • source
  • [–] 12 points 9 months ago (2 children)

    Fucking delusional twat. Either he’s on some serious drugs or this is some PR bullshit made to sound like he’s genuinely worried that Nobel laureate-level AI is right around the corner so that people will throw more money into his pocket company. Or both, could be both. But, I think he’s simply an asshole.

  • source
  • hideshow 2 child comments
  • [–] 8 points 9 months ago* (1 child)

    I think you're 100% right, and boy, this piece made me big mad. Yet another outlet breathlessly publishing fucking nonsense for a ghoul, who by uncritically publishing said ghoul’s dire warning of the imminent birth of a superintelligent malign(?) entity, serves as his unpaid marketing firm. Axios should be embarrassed. If anyone who wasn’t the head of an LLM company spouted this drivel, they’d be locked away in a padded room and Axios would rightly be called out for exacerbating the mental health crisis of a paranoid schizophrenic.

    The whole essay reads like, "Here at Anthropic, we're doing our best to create the Torment Nexus, but if anybody else were to successfully create the Torment Nexus, that would represent an existential risk for humanity. We're doing our best to create it first, so please give us more money. To save humanity. From the Torment Nexus that we created." It would be utter lunacy if he actually believed it.

  • source
  • parent
  • hideshow 1 child comment
  • [–] -1 points 9 months ago

    If anyone who wasn’t the head of an LLM company spouted this drivel, they’d be locked away in a padded room and Axios would rightly be called out for exacerbating the mental health crisis of a paranoid schizophrenic.

    Like Eliezer Yudkowsky, Roman Yampolskiy, Stuart Russell, Nick Bostrom, Yoshua Bengio, Geoffrey Hinton, Max Tegmark and Toby Ord?

  • source
  • parent
  • [+] 8 points 9 months ago (6 children)
  • [–] -2 points 9 months ago* (5 children)

    This comes across more as a warning than a sales pitch.

    If only I could convince myself to be as dismissive about the threats of AGI as the average user here seems to be...

  • source
  • parent
  • hideshow 5 child comments
  • [+] 3 points 9 months ago (4 children)
  • [–] -1 points 9 months ago* (3 children)

    It's perfectly valid to discuss the dangers of AGI whether LLMs are the path there or not. I've been concerned about AGI and ASI for far longer than I've even known about LLMs, and people were worried about exactly the same stuff back then as they are now.

    This is precisely the kind of threat you should try to find a solution for before we actually reach AGI - because once we do, it's way, way too late.

    Also:

    There is factually 0 chance we'll reach AGI with the current brand of technology.

    You couldn't possibly know that with absolute certainty.

  • source
  • parent
  • hideshow 3 child comments
  • [+] 3 points 9 months ago (2 children)
  • [–] -1 points 9 months ago* (1 child)

    Nobody knows what it actually takes to reach AGI, so nobody knows whether a certain system has enough compute and context size to get there.

    For all we know, it could turn out way simpler than anyone thought - or the exact opposite.

    My point still stands: you (or Cameron) couldn't possibly know with absolute certainty.

    I'd have zero issue with the claim if you'd included even a shred of humility and acknowledged you might be wrong. You made an absolute statement instead. That I disagree with.

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (1 reply)
  • [–] 1 point 9 months ago

    Spoiler Alert: We don't.

  • source
  • [–] 2 points 9 months ago

    The things these assclowns do and say to make themselves relevant.

  • source
  • 21 comments in c/futurology@futurology.today view that post
    [–] 24 points 9 months ago

    uh huh, sure buddy

  • source
  • [–] 22 points 9 months ago (1 child)

    Humanity is about to be handed almost unimaginable power,

    Btw, the minimum safe distance to stand from a nuclear destination is six feet. Also, it's safe to microwave aluminum, and to eat razor blades in your pizza.

    Hrm, somehow what this guy is saying does not match my experiences with AI... oh well, I'm sure it is I who must be wrong. After all, he says:

    AI is doing 90% of the computer programming to build Anthropic's products, including its own AI

    so how could that possibly go wrong?

  • source
  • hideshow 1 child comment
  • [–] 20 points 9 months ago

    "Humanity needs to see how awesome and powerful and simultaneously extremely dangerous AI is" says guy who's business is based on building AI models and developing "safety" tools for them.

  • source
  • [–] 18 points 9 months ago (3 children)

    For a second, I was optimistic and thought they were going to highlight the economic, environmental, and misinformation concerns with the ensloppification engine. Then, I read the tagline...

  • source
  • hideshow 3 child comments
  • "It is somewhat awkward to say this as the CEO of an AI company, but I think the next tier of risk is actually AI companies themselves," Amodei warns after the passage about authoritarian governments. "AI companies control large datacenters, train frontier models, have the greatest expertise on how to use those models, and in some cases have daily contact with and the possibility of influence over tens or hundreds of millions of users. ... [T]hey could, for example, use their AI products to brainwash their massive consumer user base, and the public should be alert to the risk this represents. I think the governance of AI companies deserves a lot of scrutiny."

  • source
  • parent
  • [–] 29 points 9 months ago (1 child)

    "let me spread some fear and interest in my product so I can keep getting people to invest in my company or else we're out of cash"

  • source
  • hideshow 1 child comment
  • [–] 9 points 9 months ago

    Meanwhile in the EU, AI companies are screeching about regulations that restrict AI and their risks because it hinders the innovation. Pick a lane, dude.

  • source
  • [+] 15 points 9 months ago (7 children)
  • [–] 3 points 9 months ago (1 child)

    Claude is AMAZING. The future is now! Its actually very hard to trip it up with complex trick questions like "Spell 'blueberry'" nowadays. Check out what it said when I asked it just now what tomorrow's date is (I even gave this doctorate degree-level intellect a clue that it's in 2026).

    12966

    I asked it to show its reasoning so I could help it to understand my complex query, and got this very insightful reasoning process.

    12968

    Reasoning...

    Wearegiven:"Whatdateof2026isittomorrow?"Note:Thecurrentyearis2023,sotheuserisaskingaboutafuturedaterelativetoanunknown"today"in2026.However,withoutknowingthecurrentdate(in2026)wecannotcompute"tomorrow".Thus,wemustclarifythattheanswerdependsonthecurrentdate.Butnote:Theusermightbeaskingthisquestiononaspecificday,sowecanassumethatthe"today"inthequestionisthedaywhenthequestionisbeingasked?However,thequestionisabout2026,whichisinthefuture.Sincewedon'thaveaspecificreferencedatein2026,wecannotgiveaspecificanswer.Therefore,thethoughtprocessshouldleadtoaresponsethatexplainsthedependencyandperhapsprovidesawaytocomputeitifthecurrentdatewereknown.Let'sbreakdown:1.Thequestion:"Whatdateof2026isittomorrow?"-Thisimpliesthattomorrowisadayintheyear2026.2.However,thecurrentdate(the"today"fromwhichwearecountingtomorrow)isnotprovided.Withoutknowingtoday'sdatein2026,wecannotdeterminetomorrow'sdate.3.Possibilities:a)Iftheuserisaskingthisquestionin2026,thenwecouldusethecurrentdate.Butthecurrentyearis2023,sowearenotin2026.b)Theusermightbeaskinghypothetically,butwithoutareference,wecannotcompute.4.Therefore,theanswermustbeconditionalonknowingthecurrentdate.5.Wecanprovideageneralmethod:-Tomorrow'sdatein2026isonedayafterthecurrentdate(whichmustbein2026).-Forexample,iftodayisJanuary1,2026,thentomorrowisJanuary2,2026.6.Butnote:Thequestionsays"dateof2026",soweareonlyconcernedwithdatesintheyear2026.IftodayisDecember31,2026,thentomorrowwouldbeJanuary1,2027,whichisnotin2026.Sothequestionimpliesthattomorrowmustalsobein2026.7.Therefore,theanswerisonlydefinedfordatesin2026fromJanuary1toDecember30(becauseonDecember31,tomorrowwouldbein2027).SowemustalsonotethatifthecurrentdateisDecember31,2026,thentomorrowisnotin2026.8.Approachfortheresponse:-Explainthatwithoutknowingthecurrentdatein2026,wecannotgiveaspecificanswer.-Providethegeneralrule:tomorrow'sdateisthenextdayinthecalendarafterthecurrentdate.-NotethatthecurrentdatemustbebetweenJanuary1,2026andDecember30,2026fortomorrowtoalsobein2026.-Iftheuserhasaspecificcurrentdateinmind,theycanprovideitandwecancompute.9.However,notethattheusermightbeaskingthisonaparticularday(say,thedaytheyareaskingthequestion)butin2026?Thatdoesn'tmakesensebecausewearein2023.Sowemustclarifythatwearein2023and2026isinthefuture.10.Alternativeinterpretation:Theusermightbeaskingforthedateoftomorrowintheyear2026,meaningiftodayisthesamedayoftheyearin2026asitisnowin2023?Butthatisnotastandardinterpretationandthequestiondoesnotspecify.11.Conclusion:Thequestionisambiguouswithoutareferencepoint.Wemustaskforthecurrentdatein2026orexplainthatweneedthatinformation.Butnote:Theusermightbeaskingthisquestiononaspecificday(say,June15,2023)andwanttoknowwhatdateitwouldbetomorrowin2026?Thatis,thesamedayoftheyear?However,thequestiondoesnotspecifythat.Let'sre-read:"Whatdateof2026isittomorrow?"Thisisambiguous.Itcouldmean:OptionA:"Iftodayissomedayin2026,whatdateistomorrow(in2026)?"->requiresknowingtodayin2026.OptionB:"Whatistomorrow'sdate(in2023)andthenwhatwouldthatsamedaybein2026?"->butthatwouldbethesamedayoftheyear,buttheyearchanges.However,thequestionsays"dateof2026",soOptionBwouldnotbeadatein2026iftomorrowin2023isin2023.Forexample

    I pressed 'Stop' because I'm pretty sure the poor guy was in a logic loop, and I didn't want to heat up the oceans any further with my diabolically-complex line of query.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 9 months ago* (3 children)

    I mean... Yeah. Anyone who knows even the first thing about how an LLM works is going tell you it's not qualified to answer that. That niche functionality would need to be tacked onto the LLM as, say, a deterministic algorithm it could call and report the results from.

    In a world of plenty of valid arguments against widespread generative AI, you chose one that at best says "people need to be more educated about generative AI before using it" and at worst says "I need to be more educated about generative AI before campaigning against it".

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 9 months ago (2 children)

    This is the 'next level natural language technology'?

    Always some AI white knights in the comments, bravely telling people 'you're using AI wrong. you're ignorant. you're uneducated about generative AI', as though this isn't literally the first thing that the market-leader OpenAI suggests you use it for presently.

    12969

  • source
  • parent
  • hideshow 2 child comments
  • [–] 0 points 9 months ago* (last edited 9 months ago) (1 child)

    bravely telling people ‘you’re using AI wrong.

    More like telling that person they lack such a bare minimum understanding of how an LLM works that it's comical. This is as fucking stupid as somebody complaining that their band saw can't trim their fingernails.

    literally the first thing that the market-leader OpenAI suggests you use it for presently

    "Quiz me on vocabulary"? Oh, yeah, you know, I remember all those vocabulary quizzes I had in school that asked: "How many times does the letter 't' appear in 'platitudinous'?" Oh, wait, no, it's referring to things like meaning, usage, examples sentences, etc. – actual vocabulary questions.

    I don't use LLMs since I don't find myself ever needing them, and you'll find I don't pull punches with them either, but since you're whining that the placeholder text in the input box is misleading, I used it for a vocabulary question I would otherwise use Wiktionary for:

    Asking ChatGPT what the word "platitudinous" means. It answers correctly.

    Looks good to me, boss. Either you don't understand what quizzing someone on vocabulary means or you assume the person is in kindergarten and needs to learn how to count the number of letters in a word.

  • source
  • parent
  • hideshow 1 child comment
  • [–] -1 points 9 months ago

    Correct spelling is the fundamental component of words, without words there is no vocabulary. Without understanding words, LLMs have absolutely no understanding of vocabulary. They can certainly spew out things they've tokenized and weighted from ingested inputs though - like when people trick it into believing false definitions through simply repeating them as correct and thereby manipulating (or poisoning) the weighting. ChatGPT and other LLMs regularly fail to interpret common parts of vocabulary - eg idioms, word spellings, action-reaction consequences in a sentence. They're fancy autocomplete, filled with stolen (and occasionally licensed) data.

    Sure seems like the problem isn't me or the other guy 'dont know how to use LLMs', but rather that they keep getting sold as something they're not.

    Congrats though, you just used a 100 billion dollar machine array to more or less output the exact content of a Wikipedia article - you really proved your point that it's very good when you know what to ask it, and us plebs are just dumb at questions, or something 👍 https://en.wikipedia.org/wiki/Platitude

  • source
  • parent
  • [–] 5 points 9 months ago