Hackers trick Meta AI support bot to infiltrate Obama White House Instagram account
(www.theguardian.com)
It's not impossible. It's actually pretty simple. You just don't give it access to credentials or resources or sensitive information of any kind. Does that make them basically useless? Yep. But then you don't create massive security risks and legal liabilities with gross negligence either, so... gotta weigh those things against each other.