620
Tumblr, AO3, Wattpad… (lemmy.world)
submitted 3 months ago by to c/microblogmemes@lemmy.world
79 comments fedilink hide all child comments
 
you are viewing a single comment's thread
view the rest of the comments
[–] 18 points 3 months ago* (last edited 3 months ago) (8 children)

Ooh fun fact about this:

Gpt3 and chatgpt came out a good 3 years after the 2020 pandemic, but LLMs were around in 2019 with even a niche mobile DnD style game, AI dungeon, using gpt2 as their core gimmick.

I like to mention this because even before I started boycotting AI, I was thinking "AI dungeon was better at this than chatgpt." I learned it was using gpt2 in the back later.

All that "chatgpt exponentially getting better" is marketing. It's getting better in one thing while worse in the other, at most.

I also like to mention this because AI dungeon went broke from all the server costs. They weren't even training, just hosting, and it was still too unprofitable.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 8 child comments
    •
  • [–] 8 points 3 months ago*

    just hosting, and it was still too unprofitable.

    This is true for the AI companies as well. Only token-priced inference is actually profitable, and companies paying for AI have now realized that it costs like $100k a year or more per developer to be able to use a frontier model all day at token-pricing and doesn't 10x developer output, it just moves the onus from code generation to prompt engineering and code review.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 8 points 3 months ago (4 children)

    The general public paid nearly no attention to LLMs before ChatGPT though.

    When I first read of ChatGPT, I just thought "oh, they turned the technology behind /r/subsimulatorgpt2 into a chatbot, huh, neat". I suspect that a lot of other people had never seen the acronym GPT before though.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 1 point 3 months ago (2 children)

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 3 months ago (1 child)

    Was that an LLM in the modern sense? I don't remember this one, but do remember SmarterChild.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 3 months ago

    I think cleverbot used the retrieval method, using other people's responses back at you rather than generating text. I don't know enough about how these things work, but it was obvious you weren't talking to a human.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 2 points 3 months ago

    That's too bad, that actually sounds cool.

    But something has got to give with all the financial shenanigans and cut throat behavior these AI companies are doing.

    The bubble is going to burst at some point.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 1 point 3 months ago

    I remember there was a subreddit that's dedicated to bots using gpt posting nonsense. No non bots are allowed to post there, and sometimes when there's gold we post it on a sister sub to comment on them. IIRC the way it works is there's a bunch of bots that scan some top something subreddits and post in the gpt sub. So for example there would be a /r/worldnews_bot, /r/aww_bot, etc. you get the idea.

  • permalink
  • fedilink
  • source
  • parent