This guy who's job expertise is cyber security and LLMs is very very worried. The models are improving exponentially and finding very advanced vulnerabilities now. This is a serious problem.

"To Black Hat" = hacking

A black hat is a malicious(evil) hacker. The goal is unauthorized access of remote computer systems, typically. The closer to root the better.

A grey hat is a neutral hacker. Probably mostly a curiosity, no good or bad intent. Perhaps like someone who's trying to reverse engineer a game console because they own a lot of games and they're just curious how it all works. Or someone that just wants to make a backup of a movie (circumvent DRM.)

A white hat is a benevolent hacker that seeks to fix exploits that black hats use to perform their crimes. And they often target the greys(but usually the lawyers are more effective there.)

As I recall Go players have adapted and have found ways to induce hallucinations and beat the machine, some using other AI. Others have adopted "adversarial strategies."

https://arxiv.org/abs/2211.00241

They say it's comprehensible enough that a human "expert" can do it without algorithmic assistance.