no comments (yet)

sorted by: hot top controversial new old
there doesn't seem to be anything here
26 comments in c/technology@lemmy.world view that post
[–] 63 points 1 month ago (7 children)

I'm 100% positive they're not reading my ChatGPT logs.

(I don't use ChatGPT, and neither should anyone else.)

  • source
  • hideshow 7 child comments
  • [–] 22 points 1 month ago (5 children)

    Someone can submit your messages / cv etc to chatgpt against your will.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 2 points 1 month ago (4 children)

    Sure, but how likely is that?

  • source
  • parent
  • hideshow 4 child comments
  • [–] 14 points 1 month ago (2 children)

    There probably has been some disclaimer that we all got so used to just clicking away. Saying that everything you say here will be recorded and read by 3rd parties. Or some such. Right?!

    I'm not saying this makes it OK though.

  • source
  • hideshow 2 child comments
  • [–] 1 point 1 month ago

    The disclaimer is shown when you submit feedback about you chat. They're not reading random chats, they're reading chats reported by user where ChatGPT does something awful, makes major mistakes, etc.

  • source
  • parent
  • [–] 10 points 1 month ago (4 children)

    Kinda hate to show my whole ass on this topic, but I lived through this exact thing 5 or 6 years ago when AI Dungeon accused its entire userbase of being pedophiles.

  • source
  • hideshow 4 child comments
  • [–] -1 points 1 month ago (3 children)
  • [–] 7 points 1 month ago* (last edited 1 month ago) (9 children)

    Mechanical Turk, redux.

    https://en.wikipedia.org/wiki/Mechanical_Turk

    Also, the privacy concerns are an absolute nightmare. 100% chance this leads to a massive leak.

  • source
  • hideshow 9 child comments
  • [–] 11 points 1 month ago* (last edited 1 month ago) (8 children)

    That's not what this is. Humans aren't providing the responses, they're reviewing them, grading them, and using them to train models.

    An example of a mechanical turk would be Waymo using humans to navigate situations the computer can't.

  • source
  • parent
  • hideshow 8 child comments
  • [–] 3 points 1 month ago* (last edited 1 month ago) (7 children)

    If AI is so smart, why does it need this level of baby-sitting from humans? Mechanical Turk, one step removed.

    The tech gods are saying they've reached Artificial General Intelligence, yet clearly if they have to pay humans to continually train the bots on the subtleties of human interaction, they have not reached AGI, and even feeding an LLM the entire corpus of the internet is insufficient to train them.

    As much as I think this is a good and necessary step (privacy concerns aside), it definitely does point to AI being significantly less than advertised.

  • source
  • parent
  • hideshow 7 child comments
  • [–] 6 points 1 month ago (5 children)

    It's not babysitting, it's training. The humans grading the responses is how the models are being improved. It's just a more targeted approach than "let's scan the whole internet."

    Humans aren't pretending to be AI. This is a completely different scenario than the mechanical turk.

  • source
  • parent
  • hideshow 5 child comments
  • [–] -1 points 1 month ago (4 children)

    You are correct, it is not literally talking to a person. You could even go further and point out that the trainers are not literally Turkish.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 3 points 1 month ago* (3 children)

    You seem to not be grasping the concept of the mechanical turk. The human was the one playing chess, not the machine. The machine playing chess was a lie.

    You're basically saying that a student's math teacher is actually doing the student's homework because they taught the student how to do it.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 0 points 1 month ago (2 children)

    Yes, and this machine that taught itself how to be smart from absorbing data is likewise a lie.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 3 points 1 month ago

    That still doesn't mean it's comparable to the mechanical turk. The machine didn't actually do anything. It was all the human.

    That's not the case for AI. What AI does is actually transformative, and the output is not just a person pretending to be a machine.

    A human providing the output while pretending to be a machine is a hard requirement.

  • source
  • parent
  • [–] 3 points 1 month ago*

    If AI is so smart,

    First off, the label AI is bad - it's Artificial, but Intelligent - or smart - it is not.

    LLM - Large Language Model + scaffolding. They match patterns. They build an unimaginably complex "context window" of 200,000 tokens and from that they synthesize their responses to prompts of usually a few dozen tokens based on trillions of model weights trained on hundreds of trillions of tokens. Optical character recognition has been doing this to automatically "read" the routing numbers printed on the bottom of checks since the early 1960s, that old OCR just has much much lower dimensions of patterns to match.

    The "Mechanical Turk, one step removed" is helping to tune those trillions of model weights by reinforcing when it "gets things right" and flagging when it "gets things wrong." The LLM has to find this out somehow, that's what the employees are doing - training it, teaching it right from wrong.

    AlphaZero taught itself to play chess, Go, and other relatively simple games nearly 9 years ago now - it mastered those with "best next move to win" pattern analysis / generation all by itself because the rules of those games are crisp, well defined, simple. What makes "a good response" in a conversation is a hugely different animal with orders of magnitude more dimensions and levels of nuance.

    After all this training, the next generation model should, statistically, generate "correct" conversational responses more often, according to what the inputs of the employees consider and tell the model is correct and incorrect for a given situation.

  • source
  • parent