From what I gather about current chatbots, they always sound very eloquent. They're made that way with all the textbooks and Wikipedia articles that went in. But they're not necessarily made to do therapy. ChatGPT etc are more general purpose and meant for a wide variety of tasks. And the study talks about current LLMs. So it'd be like a layman with access to lots of medical books, and they pick something that sounds very professional. But they wouldn't do what an expert does, like follow an accepted and tedious procedure, do tests, examine, diagnosis and whatever. An AI chatbot (most of the times) gives answers anyways. So could be a dice roll and then the "solution". But it's not clear whether they have any understanding of anything. And what makes me a bit wary is that AI tends to be full of stereotypes and bias, it's often overly agreeable and it praises me a lot for my math genious when I discuss computer programming questions with it. Things like that would certainly feel nice if you're looking for help or have a mental issue or looking for reaffirmation. But I don't think those are good "personality traits" for a therapist.

If its for a study maybe
Or if i just want to recklessly test with no regard for my health far enough from others that i probably cant harm them
But very unlikely