• yarr@feddit.nl
    link
    fedilink
    English
    arrow-up
    4
    ·
    18 hours ago

    I don’t read this as a win. One man finished in front of OpenAI and many, many, many finished behind OpenAI. If this is the future of coding, it’s bleak indeed.

    The top 1% of developers will probably be OK no matter what, it’s the rest of the crowd who isn’t an award winning developer that are probably in trouble.

  • saltesc@lemmy.world
    link
    fedilink
    English
    arrow-up
    74
    arrow-down
    10
    ·
    edit-2
    1 day ago

    A Polish programmer running on fumes recently accomplished what may soon become impossible: beating an advanced AI model from OpenAI

    No 🤣

    So long as the protocol is predictive or algorithm based, it won’t ever be better at the job.

    Oml. As someone that can’t wait for AI to advance well enough so I don’t have to fucking code anymore, I’m so sick of this bullshit narrative.

    The reality headline is “Barely functional expert outperforms extremely fast junior hire still in probation period.”

    We already have AI that can beat this guy, but it takes so much work that it’s still years and years and years from being able to cover all the things we consider everyday tasks. Let alone the complexities of coding, which require the fundamentals of “intelligence”, independent planning and decision making.

    It’s like that other recent news when media was flabbergasted that basic coding in a 1970s Atari chess game bested an LLM. “Yeah, no shit. It’s an LLM. Do you even know AI is an acronym, or is it just synonymous with magic at this point?”

    Common sense is as valuable as a computer science degree on this level.


    Edit: OpenAI’s route to doing what they say they can do is using what they can currently do to assist the work into actually getting there… BECAUSE ITS ALWAYS BEEN A BIG FUCKING JOB. We don’t have any massive breakthroughs, at best we’ve gotten shortcuts, but until we can physically overcome processing limitations, figure out quantum processing or similar, NO. Just, no. Ffs it takes climate destroying levels of computing power to just be at this level of absolute shit we have rn.

    I am SO sick of this general public narrative because they’ve just been given food, that’s always been there, on a plate and have nfi about how the food got onto the plate. If they did, they’d realise there’s no magic. It’s the same it’s always been but someone decided to improve it a little for the consumer.

    /rant

      • saltesc@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        1 day ago

        I expect by then, there’s more to it than scraping off StackOverflow comments grounded in a “this is the best source, therefore the output is the best” fallacy.

        The knowledge and logic components of intelligence would be nice-to-haves in the artificial version too.

  • vane@lemmy.world
    link
    fedilink
    English
    arrow-up
    16
    arrow-down
    1
    ·
    edit-2
    1 day ago

    fucking articles these days, no link to nothing, just bunch of copy paste text hype from twitter
    here’s link to problem: https://img.atcoder.jp/awtf2025heuristic/en.pdf
    here’s link to live stream: https://www.youtube.com/watch?v=TG3ChQH61vE

    edit: from stream 39:00 first solution by openai was after 15 minutes first human solution was after 38 minutes and it was 2x slower than initial openai solution

    edit2: from stream 7:20:12 winner is telling live that he slept 8-10h over last 72h, openai models are crap given he don’t know what he’s doing there, his code is crap and he doesn’t know why it’s working so well

  • scintilla@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    38
    arrow-down
    1
    ·
    edit-2
    1 day ago

    Did I miss where they talk about how the AI “coder” worked? because based on what I’ve heard from programmers it just would lie the first few times. Was a human allowed to fix mistakes that the AI made?

    Seems like the model was specifically tuned for this maybe?

    I feel like I’m missing information as to whether or not I should be impressed by the AIs performance.

    • Derpgon@programming.dev
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      1
      ·
      edit-2
      1 day ago

      From experience: Junie, and AI agent based on Sonnet 4, performs quite well. It can even write tests and fix them if they are failing.

      Not saying the quality is great, but good enough eventually work and to pass as junior code.

      Not sure how good OpenAI agent is, and if they used their coding agent Codex, and if they did then was it as-is or with some tuning? Not sure, they write it was “custom agent based on o3”.

      They write all,the contestants have the same hardware, but did the agent run on the given machine, or in the cloud? Human brain is like 20-40W, so let’s say the upper limit given he has to move his hands - did the AI agent get the same wattage? I don’t think so.

  • Sekoia@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    7
    ·
    1 day ago

    Having just read the problem, I’m curious how o3 solved it (and the human too tbh). My experience with LLMs says they’d be absolute complete crap at this, it’s a very hard and open-ended problem. Intuitively I’d say it would just end up doing random changes tryjng to improve its score.

    I think I could write the “trivial” solution but anything beyond seems… difficult. Congrats to the winner!