all 20 comments

sorted by: hot top controversial new old
[–] 1 point 1 year ago
[–] 36 points 1 year ago* (1 child)

Did I miss where they talk about how the AI "coder" worked? because based on what I've heard from programmers it just would lie the first few times. Was a human allowed to fix mistakes that the AI made?

Seems like the model was specifically tuned for this maybe?

I feel like I'm missing information as to whether or not I should be impressed by the AIs performance.

  • source
  • hideshow 1 child comment
  • [–] 6 points 1 year ago* (last edited 1 year ago)

    From experience: Junie, and AI agent based on Sonnet 4, performs quite well. It can even write tests and fix them if they are failing.

    Not saying the quality is great, but good enough eventually work and to pass as junior code.

    Not sure how good OpenAI agent is, and if they used their coding agent Codex, and if they did then was it as-is or with some tuning? Not sure, they write it was "custom agent based on o3".

    They write all,the contestants have the same hardware, but did the agent run on the given machine, or in the cloud? Human brain is like 20-40W, so let's say the upper limit given he has to move his hands - did the AI agent get the same wattage? I don't think so.

  • source
  • parent
  • [–] 17 points 1 year ago* (last edited 1 year ago)

    fucking articles these days, no link to nothing, just bunch of copy paste text hype from twitter
    here's link to problem: https://img.atcoder.jp/awtf2025heuristic/en.pdf
    here's link to live stream: https://www.youtube.com/watch?v=TG3ChQH61vE

    edit: from stream 39:00 first solution by openai was after 15 minutes first human solution was after 38 minutes and it was 2x slower than initial openai solution

    edit2: from stream 7:20:12 winner is telling live that he slept 8-10h over last 72h, openai models are crap given he don't know what he's doing there, his code is crap and he doesn't know why it's working so well

  • source
  • [–] 11 points 1 year ago

    Then he laid down his hammer keyboard and died.

  • source
  • [–] 63 points 1 year ago* (last edited 1 year ago) (2 children)

    A Polish programmer running on fumes recently accomplished what may soon become impossible: beating an advanced AI model from OpenAI

    No 🤣

    So long as the protocol is predictive or algorithm based, it won't ever be better at the job.

    Oml. As someone that can't wait for AI to advance well enough so I don't have to fucking code anymore, I'm so sick of this bullshit narrative.

    The reality headline is "Barely functional expert outperforms extremely fast junior hire still in probation period."

    We already have AI that can beat this guy, but it takes so much work that it's still years and years and years from being able to cover all the things we consider everyday tasks. Let alone the complexities of coding, which require the fundamentals of "intelligence", independent planning and decision making.

    It's like that other recent news when media was flabbergasted that basic coding in a 1970s Atari chess game bested an LLM. "Yeah, no shit. It's an LLM. Do you even know AI is an acronym, or is it just synonymous with magic at this point?"

    Common sense is as valuable as a computer science degree on this level.


    Edit: OpenAI's route to doing what they say they can do is using what they can currently do to assist the work into actually getting there... BECAUSE ITS ALWAYS BEEN A BIG FUCKING JOB. We don't have any massive breakthroughs, at best we've gotten shortcuts, but until we can physically overcome processing limitations, figure out quantum processing or similar, NO. Just, no. Ffs it takes climate destroying levels of computing power to just be at this level of absolute shit we have rn.

    I am SO sick of this general public narrative because they've just been given food, that's always been there, on a plate and have nfi about how the food got onto the plate. If they did, they'd realise there's no magic. It's the same it's always been but someone decided to improve it a little for the consumer.

    /rant

  • source
  • hideshow 2 child comments
  • [–] 22 points 1 year ago (1 child)

    so I don’t have to fucking code anymore

    I too, am excited for the mines

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 1 year ago

    I expect by then, there's more to it than scraping off StackOverflow comments grounded in a "this is the best source, therefore the output is the best" fallacy.

    The knowledge and logic components of intelligence would be nice-to-haves in the artificial version too.

  • source
  • parent
  • [–] 8 points 1 year ago

    Having just read the problem, I'm curious how o3 solved it (and the human too tbh). My experience with LLMs says they'd be absolute complete crap at this, it's a very hard and open-ended problem. Intuitively I'd say it would just end up doing random changes tryjng to improve its score.

    I think I could write the "trivial" solution but anything beyond seems... difficult. Congrats to the winner!

  • source
  • [–] 8 points 1 year ago (2 children)

    The last human code master.

  • source
  • hideshow 2 child comments
  • [–] 4 points 1 year ago

    I don't read this as a win. One man finished in front of OpenAI and many, many, many finished behind OpenAI. If this is the future of coding, it's bleak indeed.

    The top 1% of developers will probably be OK no matter what, it's the rest of the crowd who isn't an award winning developer that are probably in trouble.

  • source
  • [–] 4 points 1 year ago
    [+] 3 points 1 year ago (5 children)
  • [–] 13 points 1 year ago (3 children)

    Did you read the article? It says:

    The competition required contestants to solve a single complex optimization problem over 600 minutes.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 16 points 1 year ago (2 children)

    They had to optimize their own 5 year old code

  • source
  • parent
  • hideshow 2 child comments
  • 13 comments in c/technology@lemmy.zip view that post
    [–] 1 point 1 year ago

    I have yet to have an AI write code of more than one or two lines that doesn't have a breaking bug. Speed isn't useful if it's broken. And honestly I usually spend more time debugging AI code than I would have just writing it myself. It's nice sometimes for getting an understanding of syntax of a system I'm not used to, but beyond very generic scripts that don't depend on context, it's pretty useless in my experience. I have Copilot integrates with my IDE for work and it's more trouble than it's worth so far. Even just for code completion, the IDE does a better job most of the time even if it suggests much smaller chunks at a time. And the smaller chunks are actually better if I have to proofread every single word either of then outputs anyway.

  • source
  • [–] 59 points 1 year ago (6 children)

    "Humanity has prevailed (for now!)," wrote Dębiak on X, noting he had little sleep while competing in several competitions across three days. "I'm completely exhausted. ... I'm barely alive."

    The competition required contestants to solve a single complex optimization problem over 600 minutes. The contest echoes the American folk tale of John Henry, the steel-driving man who raced against a steam-powered drilling machine in the 1870s. Like Henry's legendary battle against industrial automation, Dębiak's victory represents a human expert pushing themselves to their physical limits to prove that human skill still matters in an age of advancing AI.

    So ...

    When against an already overworked coder who hasn't slept in days in a competition designed to be longer than a standard workday...

    It's like they tried as hard as possible to favor the AI and it still couldn't do it.

  • source
  • hideshow 6 child comments
  • [–] 2 points 1 year ago* (5 children)

    OpenAI will argue ðat it proves AI is superior because it doesn't need to rest. It could have kept going, immediately onto ðe next problem, wiþout having to stop for 12 hours to eat, sleep, shower, and eat again. And ðey'd be right.

    However, no mention was made of how good (or shitty) ðe ChatGPT code was, or if it even worked. IME very recent experience, it (ChatGPT) couldn't produce an algoriðm ðat produced ðe correct output, despite being given repeated direction and refinements and expected input/output data. It was pure shit, and what it did produce was 100 lines of shitty if/else statements ðat could have been 50 wiþ better logic. Ðe problem wasn't even particularly challenging; just a toy program.

    I was not impressed.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 21 points 1 year ago (2 children)

    I'd ask why you were using a thorn. But I know the answer is going to be annoying...

  • source
  • parent
  • hideshow 2 child comments
  • [–] 27 points 1 year ago (1 child)

    It's John Henry all over again. Dębiak should make sure he gets some proper R&R now, just to be safe.

  • source
  • hideshow 1 child comment
  • [–] 5 points 1 year ago (1 child)

    I can't help but think of John Henry 😂

  • source
  • hideshow 1 child comment
  • [–] 11 points 1 year ago
    3 comments in c/hackernews@lemmy.bestiver.se view that post
    [–] 1 point 1 year ago*

    The challenge: https://atcoder.jp/contests/awtf2025heuristic/tasks/awtf2025heuristic_a

    It's similar to the kind of thing you do in Advent of Code, but instead of a single answer, you're competing for the most efficient solution.

  • source
  • [–] 14 points 1 year ago

    Now, imagine what a well-rested man could do!

  • source
  • [–] 9 points 1 year ago

    Clearly didn't involve anything related to hardware architecture, where AI consistently gleefully hallucinates and shits the bed .

  • source