I thought they somehow managed to trick it into revealing the keys of the systems it was running on, but these are just random kms keys from forums.

Still neat how they use tags to obfuscate the filtered keywords. Gonna have to remember that one.

doesn't seem that big of a deal. these are kms client activation keys, you can even find them on official microsoft pages. all public information. even if they weren't one could say search engines have the exact same problem and even argue LLMs make these private info harder to believe/obfuscated.

Cool, now do it with an SSN and DOB and see what you get.

That's nothing. If you do it the right way, they can help you set up Linux and be free of Microsoft's garbage!

I’m trying so many angles to tell people how mundane shit like this is, let me try one more:

it’s not interesting that an LLM can pull back something anyone can find in a google search result if they took more than 2 minutes. Stop writing articles about this shit.

Since everyone apparently missed the point of the article, the interesting part isn’t the keys, it’s the bypassing of the guardrails.