15
A 150M param recurrent model scores 29.5% on ARC-AGI-1 at $0.0007 per task (arxiv.org)
submitted 2 months ago by to c/artificial_intel@lemmy.ml
9 comments fedilink hide all child comments

all 10 comments

sorted by: hot top controversial new old
[–] 5 points 2 months ago (6 children)

  • permalink
  • fedilink
  • source
  • hideshow 6 child comments
    •
  • [–] 7 points 2 months ago (3 children)

    29% is probably somewhere between meh and ok-ish.

    150M is extremely small. The B stands for billion parameters, so the M stands for million parameters. So we're talking 3% the size of recent mid-tier models.

    What this means is someone made a tiny model, and it scored way better than we thought. The conclusion is (I assume) we can make models way smaller at the same quality.

    That's huge, because that would mean in a matter of years anyone can deploy their own model on the most dog shit hardware. This would kill AI companies, it would neuter Nvidia and it would mean PC components will decrease to suitable prices. And it also means even in poor countries people have access to AI which I personally think is one of the most noble things to finally make people more equal by giving them lots of knowledge.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 1 point 2 months ago (1 child)

    Mostly right but don't forget that technological advancement never leads to cheaper more affordable components, and more equality for the people Just the opposite the big techs continues growing faster utilizing even more ressources

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
    • [–] 1 point 2 months ago (1 child)

    i have seen sub-100 models perform excellent on some basic tasks

  • permalink
  • fedilink
  • source
  • hideshow 1 child comment
    •