I couldn't find replays. Are there more? Also, it is a bit funny that "building the bridge" which at one point seems to be Claude's "chosen goal" is just "running out of moves" and failing the task.

Task failed successfully, Claude. Task failed, successfully.

My understanding is that Claude is particularly geared towards being a tool for people to use rather than a human replacement. That's why they had that whole spat with the Pentagon about a human needing to be in the loop.

When Sammy fuck says “we’re so close to AGI, I can just feel it. Like a tingle on the tip of my shrimpdick it’s getting so close to blossoming into something guys”, just ignore him. He’s crazy man!

"Sam Altman claims AGI is coming in 2025 and machines will be able to 'think like humans' when it happens"

just when he had to shut down sora, because making ai videos is too expensive.

I assume it’s an hourly wage or something. Just because humans can work for free if they choose, doesn’t mean they have no cost associated with them. Just like a company could choose to give away unlimited tokens, those tokens still have a standard cost.

That is how much individual testing humans cost when you buy them in bulk.

Youd have to eat $250 worth of burgers to pass it.

it's also an odd metric since only 20-60% of the humans completed it. Very 60% of the time they complete it everytime energy.

Ideally they'd run the bots multiple times through (with no context or training of previous run), but I guess that is cost prohibitive?

Because I ain't doing this shit for free.

This is my rough upper-bound estimate based on the Technical Report. Human participants were paid to complete and evaluate the tasks at an average fixed fee of $128 plus $5 for solved tasks. So if a panel of humans were tasked with solving the 25 tasks in the public test set, it would be an average of $250 per person. Although, looking at it again, the costs listed for the LLMs is per task, so it would actually be more like $10 per human per task. In any case it's one or two orders of magnitude less than the LLMs.

Participants received a fixed participation fee of $115–$140 for completing the session, along with a $5 performance-based incentive for each environment successfully solved

https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf

Funnier yet will be if they continue to just train the model on that particular kind of test, invalidating its results in the process.

Oh that's an interesting challenge.

I hear some LLMs now have some solutions for the classic "how many Rs in 'strawberry'" problem (related to the tokenization processes), but I have no idea how they might solve the phonetic thing. I'm sure some smart people will eventually find a way though

Wait, I thought phonetically (example: papa hotel oscar novermber echo tango india charle alfa lima lima yankee) meant using a phonetic alphabet, not using word(s) with the same Soundex encoding.

We're anti-AI because AI is fucking stupid. Both literally and figuratively.

Well... It cannot even search databases without errors.

LLMs just produce plausible replies in natural languages very quickly and this is useful in certain situations. Sometimes it helps humans getting started with a task, but as it is now, it cannot replace them. As much as the capital class want it, and sink our money into it.

Ya i agree. The whole infrastructure of how these work is flawed for a true AI/AGI.

It might be able to do a lot of cool things, but its fundamentally flawed at its core.

Someone will need to figure out something completely different for a true AI.

Right? I have a Google Home Mini in our kitchen and if we ask it a question it just pulls a source from a website and tells us. That's it. Nothing intelligent about it.

AI now is no different. It's just pulling more complex wording from more (albeit illegally) sources to give a (albeit sometimes incorrect) better description of the question asked.

AI is just as stupid as Alexa is/was 15 years ago. It just has more information to pull from and still fucks it up.

Not the point

https://arcprize.org/arc-agi/1

https://arcprize.org/arc-agi/2

(They were more static, but yes, eventually frontier models got good at them.)

AI won them