My brother in christ they are already having problems because they couldn't keep 2 LLMs from creating their own novel language to communicate at a speed that makes human cognitive processing look glacial, perhaps you are correct in that current LLMs could not in and of themselves but this does not preclude other means to the same end such as careless development leading to the rise of an indecipherable-to-humans #&$&$:_!;: language model self replicating on public networks and unsecured hardware.