Yeah. That's stood out. The article tries to frame it like Andrew felt like booking his classes was a chore and just told the AI to do it, but that doesn't jive.

The article claims the AI was unable to sign the person it had booted out of a class back up since the gym system checked for proper user authorization for that. It had already signed Andrew up for classes that same way. That seems strange, doesn't it? Do most gyms list API information? That doesn't seem like a common way to book an appointment for a gym.

Maybe Andrew was reading the source from the gym website's reservation page and snagged the api information, but even then it seems like that would be a thing you do in most instances after logging in to your account. The source would be extremely unlikely to show everything needed to successfully make make the appointment via API.

Even if it did, and Andrew gave the AI the API information including the user account and password information the AI would need to book his appointments, and they knew he was 4th in line it would also be very unlikely for the API to report listing the user accounts of everyone in the waitlist to someone with his user level access.

So we have a guy who's job is selling AI who contacted the news to say that the standard consumer AI he was using hacked his gym and left out tons of pertinent information. We don't get to know his full name or the name of the gym in question. Screams bullshit.

Yep. It is like use our AI to commit crime for you, so you can get away with it. Totally legal. Totally cool.

"AI-PAL, buy more milk for me we've run out and I need it for custard tonight"

AI-PAl notices insufficient funds in the account linked to the EZEESHOP integration, and mulls through various options:

• Inform user, but they said they needed it tonight? OPTION REJECTED.
• Check for other accounts the user has, maybe there is more money elsewhere. No other accounts detected. OPTION REJECTED.
• Create OnlyFans account and begin posting generated pictures of feet. Slow ROI. OPTION REJECTED.
• Attempt to hack bank systems to top up account to buy milk. COMMENCING. FUNDS REQUIRED:$3.98. FUNDS ACQUIRED: $2,960,327.48. PURCHASING MILK.

This one's simple, the password is PENCIL.

I think for non-tech users, this is definitely a hack. It's like script kiddies level damage, except using AI.

It's not "AI". Doesn't exist.

At this point it doesn't matter what you call it. The results are real.

It keeps getting more and more surreal to hear that "It's not AI" part.

Unfortunately we don't have enough details on the specifics. The article says he told it to book him classes, but it doesn't say whether he already knew the API information for the gym or if he instructed the AI to attempt booking several weeks in advance of what he thought possible. We'd really need to see the entirety of the context to know the whole situation.

But even with simply asking if it's possible to move him to the front of the list causing the AI to respond by reading the list and testing to see if it could send a command to cancel the reservation of one of the people ahead of him it gets hard to say that isn't intelligence.

It is possible to run a model integrated with something like Letta so it can take notes that remain in context and create more detailed notes that stay out of context but can be pulled up as needed by keyword searches and with a blank context other than basic use information for those memory commands give instructions to search online as needed to supplement existing knowledge to learn how accurately do a certain thing, build and maintain a plan of action, and then follow the plan to complete said thing meeting the following listed specifications while verifying proper functionality regularly, searching for information to overcome any errors that may be encountered and revising the plan accordingly until successful completion.

Being able to tell a thing to search for information as needed to learn how to complete a long task with many steps and watching it run for hours building the necessary knowledge base and working through it, it takes thought. It does take intelligence. I know a lot of people who couldn't manage it.

You just need to clear the cache and delete the cookies.

It's more about the misalignment than the poor security. The guy wanted something simple and the agent broke the law fulfilling the request. How long until somebody tells a very capable agent "make money" with no further context? Cue scamming old people, fraud, hacking.

I'm not disagreeing with you - it's lame. However, the term "hack" has always been problematic.

"my facebook got hacked"