▲ 504 ▼ AIs can’t stop recommending nuclear strikes in war game simulations (www.newscientist.com) submitted 8 months ago by Valnao@sh.itjust.works to c/technology@lemmy.world 122 comments fedilink hide all child comments
[–] Jax@sh.itjust.works 4 points 8 months ago (9 children) Radiation absolutely fucks electronic components permalink fedilink source parent hideshow 9 child comments replies: [–] Earthman_Jim@lemmy.zip 1 point 8 months ago* (3 children) The electromagnetic pulse caused by a nuke would pop resisters too. AI would more likely use biological means to get rid of us. permalink fedilink source parent hideshow 3 child comments replies: [–] SocialMediaRefugee@lemmy.world 2 points 8 months ago (1 child) Assuming AI would care about itself and not just "solving the problem". permalink fedilink source parent hideshow 1 child comment replies: [–] Earthman_Jim@lemmy.zip 1 point 8 months ago Yeah, these doom scenarios require cascading assumptions and no real answer, except maybe "don't". permalink fedilink source parent [–] NihilsineNefas@slrpnk.net 1 point 8 months ago Like heating the planet another degree and starving us out of existence by killing off biodiversity until the crops die out... Like they're doing now? (I say "Us" when I just really mean the 99% of people that haven't got self sufficient underground complexes) permalink fedilink source parent [–] hector@lemmy.today 0 points 8 months ago (4 children) I think the emp is pretty limited to the blast zone in frying electronics. The fallout from a weapon spreads around the world, circling in the winds countless times dropping dust everywhere, but the emp is localized to more around the area of physical destruction but not sure exactly. The Neutron bombs, not entirely sure in physics how that works, but they produce no actual blast that causes physical destruction so much and just kills everything. permalink fedilink source parent hideshow 4 child comments replies: [–] Jax@sh.itjust.works 4 points 8 months ago (3 children) I repeat, radiation absolutely fucks electronic components. I am not talking about an emp, I am talking about radiation. permalink fedilink source parent hideshow 3 child comments replies: [–] hector@lemmy.today 1 point 8 months ago (2 children) Oh, how far from the blast and how does it mess them up do you know? I should know that I guess I just heard about the emp, and not sure how a neutron bomb would affect electronics either. permalink fedilink source parent hideshow 2 child comments replies: [–] Jax@sh.itjust.works 2 points 8 months ago* (1 child) No, that I can't answer — it would depend entirely on the level of fallout and where it happens to land. You would need to be able to perfectly, and I mean perfectly, predict weather months in advance in order to prepare accordingly. The reaility is that for an AI, or rather an AGI, to make the choice to launch nukes would require them to reach a point where they accept the potential loss of their own 'life' in exchange for whatever value a nuclear war might hold. I struggle to believe that a 'true' AGI would make that choice. There are far too many variables to control in comparison to a biological agent, one that likely would not affect a machine. Now, a modern AI making that choice? Absolutely possible, the things are fucking crazy with literally no concept of what life is. permalink fedilink source parent hideshow 1 child comment replies: [–] unwarlikeExtortion@lemmy.ml 1 point 8 months ago An AI can easily start nuclear war, as can a human. The only thing preventing a nuclear disaster are all the institutional measures limiting its accessiblity. If you gave a single human (or a single AI) access to a magic no-strings-attached 'Send a Nuke' button, either the human/AI is the second coming of Jesus Christ, or a nuke will befall some unlucky portion of the population sooner or later. Bonus points if people can talk to the AI or if access to the button is hereditary. permalink fedilink source parent
[–] Earthman_Jim@lemmy.zip 1 point 8 months ago* (3 children) The electromagnetic pulse caused by a nuke would pop resisters too. AI would more likely use biological means to get rid of us. permalink fedilink source parent hideshow 3 child comments replies: [–] SocialMediaRefugee@lemmy.world 2 points 8 months ago (1 child) Assuming AI would care about itself and not just "solving the problem". permalink fedilink source parent hideshow 1 child comment replies: [–] Earthman_Jim@lemmy.zip 1 point 8 months ago Yeah, these doom scenarios require cascading assumptions and no real answer, except maybe "don't". permalink fedilink source parent [–] NihilsineNefas@slrpnk.net 1 point 8 months ago Like heating the planet another degree and starving us out of existence by killing off biodiversity until the crops die out... Like they're doing now? (I say "Us" when I just really mean the 99% of people that haven't got self sufficient underground complexes) permalink fedilink source parent
[–] SocialMediaRefugee@lemmy.world 2 points 8 months ago (1 child) Assuming AI would care about itself and not just "solving the problem". permalink fedilink source parent hideshow 1 child comment replies: [–] Earthman_Jim@lemmy.zip 1 point 8 months ago Yeah, these doom scenarios require cascading assumptions and no real answer, except maybe "don't". permalink fedilink source parent
[–] Earthman_Jim@lemmy.zip 1 point 8 months ago Yeah, these doom scenarios require cascading assumptions and no real answer, except maybe "don't". permalink fedilink source parent
[–] NihilsineNefas@slrpnk.net 1 point 8 months ago Like heating the planet another degree and starving us out of existence by killing off biodiversity until the crops die out... Like they're doing now? (I say "Us" when I just really mean the 99% of people that haven't got self sufficient underground complexes) permalink fedilink source parent
[–] hector@lemmy.today 0 points 8 months ago (4 children) I think the emp is pretty limited to the blast zone in frying electronics. The fallout from a weapon spreads around the world, circling in the winds countless times dropping dust everywhere, but the emp is localized to more around the area of physical destruction but not sure exactly. The Neutron bombs, not entirely sure in physics how that works, but they produce no actual blast that causes physical destruction so much and just kills everything. permalink fedilink source parent hideshow 4 child comments replies: [–] Jax@sh.itjust.works 4 points 8 months ago (3 children) I repeat, radiation absolutely fucks electronic components. I am not talking about an emp, I am talking about radiation. permalink fedilink source parent hideshow 3 child comments replies: [–] hector@lemmy.today 1 point 8 months ago (2 children) Oh, how far from the blast and how does it mess them up do you know? I should know that I guess I just heard about the emp, and not sure how a neutron bomb would affect electronics either. permalink fedilink source parent hideshow 2 child comments replies: [–] Jax@sh.itjust.works 2 points 8 months ago* (1 child) No, that I can't answer — it would depend entirely on the level of fallout and where it happens to land. You would need to be able to perfectly, and I mean perfectly, predict weather months in advance in order to prepare accordingly. The reaility is that for an AI, or rather an AGI, to make the choice to launch nukes would require them to reach a point where they accept the potential loss of their own 'life' in exchange for whatever value a nuclear war might hold. I struggle to believe that a 'true' AGI would make that choice. There are far too many variables to control in comparison to a biological agent, one that likely would not affect a machine. Now, a modern AI making that choice? Absolutely possible, the things are fucking crazy with literally no concept of what life is. permalink fedilink source parent hideshow 1 child comment replies: [–] unwarlikeExtortion@lemmy.ml 1 point 8 months ago An AI can easily start nuclear war, as can a human. The only thing preventing a nuclear disaster are all the institutional measures limiting its accessiblity. If you gave a single human (or a single AI) access to a magic no-strings-attached 'Send a Nuke' button, either the human/AI is the second coming of Jesus Christ, or a nuke will befall some unlucky portion of the population sooner or later. Bonus points if people can talk to the AI or if access to the button is hereditary. permalink fedilink source parent
[–] Jax@sh.itjust.works 4 points 8 months ago (3 children) I repeat, radiation absolutely fucks electronic components. I am not talking about an emp, I am talking about radiation. permalink fedilink source parent hideshow 3 child comments replies: [–] hector@lemmy.today 1 point 8 months ago (2 children) Oh, how far from the blast and how does it mess them up do you know? I should know that I guess I just heard about the emp, and not sure how a neutron bomb would affect electronics either. permalink fedilink source parent hideshow 2 child comments replies: [–] Jax@sh.itjust.works 2 points 8 months ago* (1 child) No, that I can't answer — it would depend entirely on the level of fallout and where it happens to land. You would need to be able to perfectly, and I mean perfectly, predict weather months in advance in order to prepare accordingly. The reaility is that for an AI, or rather an AGI, to make the choice to launch nukes would require them to reach a point where they accept the potential loss of their own 'life' in exchange for whatever value a nuclear war might hold. I struggle to believe that a 'true' AGI would make that choice. There are far too many variables to control in comparison to a biological agent, one that likely would not affect a machine. Now, a modern AI making that choice? Absolutely possible, the things are fucking crazy with literally no concept of what life is. permalink fedilink source parent hideshow 1 child comment replies: [–] unwarlikeExtortion@lemmy.ml 1 point 8 months ago An AI can easily start nuclear war, as can a human. The only thing preventing a nuclear disaster are all the institutional measures limiting its accessiblity. If you gave a single human (or a single AI) access to a magic no-strings-attached 'Send a Nuke' button, either the human/AI is the second coming of Jesus Christ, or a nuke will befall some unlucky portion of the population sooner or later. Bonus points if people can talk to the AI or if access to the button is hereditary. permalink fedilink source parent
[–] hector@lemmy.today 1 point 8 months ago (2 children) Oh, how far from the blast and how does it mess them up do you know? I should know that I guess I just heard about the emp, and not sure how a neutron bomb would affect electronics either. permalink fedilink source parent hideshow 2 child comments replies: [–] Jax@sh.itjust.works 2 points 8 months ago* (1 child) No, that I can't answer — it would depend entirely on the level of fallout and where it happens to land. You would need to be able to perfectly, and I mean perfectly, predict weather months in advance in order to prepare accordingly. The reaility is that for an AI, or rather an AGI, to make the choice to launch nukes would require them to reach a point where they accept the potential loss of their own 'life' in exchange for whatever value a nuclear war might hold. I struggle to believe that a 'true' AGI would make that choice. There are far too many variables to control in comparison to a biological agent, one that likely would not affect a machine. Now, a modern AI making that choice? Absolutely possible, the things are fucking crazy with literally no concept of what life is. permalink fedilink source parent hideshow 1 child comment replies: [–] unwarlikeExtortion@lemmy.ml 1 point 8 months ago An AI can easily start nuclear war, as can a human. The only thing preventing a nuclear disaster are all the institutional measures limiting its accessiblity. If you gave a single human (or a single AI) access to a magic no-strings-attached 'Send a Nuke' button, either the human/AI is the second coming of Jesus Christ, or a nuke will befall some unlucky portion of the population sooner or later. Bonus points if people can talk to the AI or if access to the button is hereditary. permalink fedilink source parent
[–] Jax@sh.itjust.works 2 points 8 months ago* (1 child) No, that I can't answer — it would depend entirely on the level of fallout and where it happens to land. You would need to be able to perfectly, and I mean perfectly, predict weather months in advance in order to prepare accordingly. The reaility is that for an AI, or rather an AGI, to make the choice to launch nukes would require them to reach a point where they accept the potential loss of their own 'life' in exchange for whatever value a nuclear war might hold. I struggle to believe that a 'true' AGI would make that choice. There are far too many variables to control in comparison to a biological agent, one that likely would not affect a machine. Now, a modern AI making that choice? Absolutely possible, the things are fucking crazy with literally no concept of what life is. permalink fedilink source parent hideshow 1 child comment replies: [–] unwarlikeExtortion@lemmy.ml 1 point 8 months ago An AI can easily start nuclear war, as can a human. The only thing preventing a nuclear disaster are all the institutional measures limiting its accessiblity. If you gave a single human (or a single AI) access to a magic no-strings-attached 'Send a Nuke' button, either the human/AI is the second coming of Jesus Christ, or a nuke will befall some unlucky portion of the population sooner or later. Bonus points if people can talk to the AI or if access to the button is hereditary. permalink fedilink source parent
[–] unwarlikeExtortion@lemmy.ml 1 point 8 months ago An AI can easily start nuclear war, as can a human. The only thing preventing a nuclear disaster are all the institutional measures limiting its accessiblity. If you gave a single human (or a single AI) access to a magic no-strings-attached 'Send a Nuke' button, either the human/AI is the second coming of Jesus Christ, or a nuke will befall some unlucky portion of the population sooner or later. Bonus points if people can talk to the AI or if access to the button is hereditary. permalink fedilink source parent