Ah yes, those chatbots that helped people plan their suicide. Very helpful and in no way a flawed technology
post
I don't see how the non-profit is relevant there. If it works then it works independent of who made it. I just don't think we're there yet. If you're stranded on a deserted island then maybe it'll do a better job keeping you sane than Wilson does but in its current form it's nowhere near the replacement for real human connection.
The suicide examples people love to bring up are not because the evil corporations made them such - it's an inherent flaw of the systems themselves.
Yes. We all train chatbots the same way. There's a first step where it's fed a lot of text to learn to mimic coherent language and learn facts. And then there's a second step where we tune it to do the thing we want it to do. For example write dialogue, answer questions... In contrast to for example write a novel or write unproductive Reddit arguments.
All of this happens disregarding of who does it. A commercial business or a non-profit. And you'd be left with a similar result with all the upsides and downsides of a chatbot. It will hallucinate, make people spiral into stuff, give bad advice... Amplify mental disorders. That's just what chatbots do, due to how they're made. And there's currently no way around it.
So it really doesn't matter all that much who does it. It'd help if we had a different type of chatbot which isn't subject to the same kinds of limitations. But we don't.
I don't agree with the typical attitude of unconditional rejection of AI, and find it pretty useful overall. But I am skeptical this is a good thing for it to be used for, because a big part of the problem and cause of loneliness and depression is all the ways our society is structurally isolating people and cutting them off from each other's support, which is itself a larger problem than the mental distress it produces. Ways of partially alleviating that distress which cannot result in any sort of human connection (not just AI companions, there are lots of things that do this to varying degrees) I think are ultimately making it worse, because support isn't one-way, if someone is cut off from others, others are also cut off from them.
Your computer is still just your computer, it isn't capable of being your friend, because it isn't a person, even though it's better than a corporation, which isn't a person and also has bad intentions towards people. The best it can do is help you communicate with others.
I mean if the chatbots made all the lonely and depressed folk off themselves, that techinically would fix the issue for like 5 minutes, until the new folk get depressed and lonely.
all 14 comments