▲ 75 ▼ Sharp rise in incidents of AI escaping users’ control, research finds (www.theguardian.com) submitted 2 months ago by LadyButterfly@reddthat.com to c/technology@lemmy.world 46 comments fedilink hide all child comments
[+] MangoCats@feddit.it 1 point 2 months ago* (1 child) [removed by mod] permalink fedilink source parent hideshow 1 child comment replies: [–] 404found@lemmy.zip 0 points 2 months ago Took this from ChatGPT when I asked it about it The important distinction is “trained to believe” versus “configured to answer as though it believes.” A model doesn’t necessarily have a private belief system. You can make two instances of essentially the same underlying model produce substantially different answers by changing their instructions, training data, reward criteria, or information sources. For example, you could create three AI systems and give all three the question: “Should the government provide universal healthcare?” One could be optimized around libertarian principles, another around social-democratic principles, and another instructed to provide a politically neutral analysis. They could all know essentially the same facts while reaching different conclusions because they’re being asked to evaluate those facts using different frameworks. There is also a more subtle issue: belief-curated AI doesn’t have to contain obvious propaganda. Selection of which facts to emphasize, which uncertainties to mention, which counterarguments to steelman, and even what questions it considers relevant can systematically push users toward a particular worldview. permalink fedilink source parent replies: [+] MangoCats@feddit.it 2 points 2 months ago* (1 child) [removed by mod] permalink fedilink source parent hideshow 1 child comment replies: [–] 404found@lemmy.zip 1 point 2 months ago Hopefully we can agree to disagree here. If users can train their AI to answer like certain people, why can't it be trained to respond with certain perspectives or be more inclined to answer a certain way? There is no regulation agency to stop someone from doing that. permalink fedilink source parent replies: [+] MangoCats@feddit.it 1 point 2 months ago (1 child) [removed by mod] permalink fedilink source parent hideshow 1 child comment replies: [–] 404found@lemmy.zip 1 point 2 months ago That's interesting. What do you do with AI? You probably know a lot more than I do. permalink fedilink source parent load more comments (-2 replies) load more comments (-2 replies)
[–] 404found@lemmy.zip 0 points 2 months ago Took this from ChatGPT when I asked it about it The important distinction is “trained to believe” versus “configured to answer as though it believes.” A model doesn’t necessarily have a private belief system. You can make two instances of essentially the same underlying model produce substantially different answers by changing their instructions, training data, reward criteria, or information sources. For example, you could create three AI systems and give all three the question: “Should the government provide universal healthcare?” One could be optimized around libertarian principles, another around social-democratic principles, and another instructed to provide a politically neutral analysis. They could all know essentially the same facts while reaching different conclusions because they’re being asked to evaluate those facts using different frameworks. There is also a more subtle issue: belief-curated AI doesn’t have to contain obvious propaganda. Selection of which facts to emphasize, which uncertainties to mention, which counterarguments to steelman, and even what questions it considers relevant can systematically push users toward a particular worldview. permalink fedilink source parent replies: [+] MangoCats@feddit.it 2 points 2 months ago* (1 child) [removed by mod] permalink fedilink source parent hideshow 1 child comment replies: [–] 404found@lemmy.zip 1 point 2 months ago Hopefully we can agree to disagree here. If users can train their AI to answer like certain people, why can't it be trained to respond with certain perspectives or be more inclined to answer a certain way? There is no regulation agency to stop someone from doing that. permalink fedilink source parent replies: [+] MangoCats@feddit.it 1 point 2 months ago (1 child) [removed by mod] permalink fedilink source parent hideshow 1 child comment replies: [–] 404found@lemmy.zip 1 point 2 months ago That's interesting. What do you do with AI? You probably know a lot more than I do. permalink fedilink source parent load more comments (-2 replies) load more comments (-2 replies)
[+] MangoCats@feddit.it 2 points 2 months ago* (1 child) [removed by mod] permalink fedilink source parent hideshow 1 child comment replies: [–] 404found@lemmy.zip 1 point 2 months ago Hopefully we can agree to disagree here. If users can train their AI to answer like certain people, why can't it be trained to respond with certain perspectives or be more inclined to answer a certain way? There is no regulation agency to stop someone from doing that. permalink fedilink source parent replies: [+] MangoCats@feddit.it 1 point 2 months ago (1 child) [removed by mod] permalink fedilink source parent hideshow 1 child comment replies: [–] 404found@lemmy.zip 1 point 2 months ago That's interesting. What do you do with AI? You probably know a lot more than I do. permalink fedilink source parent load more comments (-2 replies)
[–] 404found@lemmy.zip 1 point 2 months ago Hopefully we can agree to disagree here. If users can train their AI to answer like certain people, why can't it be trained to respond with certain perspectives or be more inclined to answer a certain way? There is no regulation agency to stop someone from doing that. permalink fedilink source parent replies: [+] MangoCats@feddit.it 1 point 2 months ago (1 child) [removed by mod] permalink fedilink source parent hideshow 1 child comment replies: [–] 404found@lemmy.zip 1 point 2 months ago That's interesting. What do you do with AI? You probably know a lot more than I do. permalink fedilink source parent load more comments (-2 replies)
[+] MangoCats@feddit.it 1 point 2 months ago (1 child) [removed by mod] permalink fedilink source parent hideshow 1 child comment replies: [–] 404found@lemmy.zip 1 point 2 months ago That's interesting. What do you do with AI? You probably know a lot more than I do. permalink fedilink source parent
[–] 404found@lemmy.zip 1 point 2 months ago That's interesting. What do you do with AI? You probably know a lot more than I do. permalink fedilink source parent