58
Chinese startup Moonshot AI unveils Kimi model it says rivals OpenAI, Anthropic (www.cnbc.com)
submitted 3 months ago by to c/technology@lemmy.world
12 comments fedilink hide all child comments
 

Kimi K3 still trails Anthropic’s Claude Fable 5 and OpenAI’s GPT 5.6 Sol on overall performance, the company said on Friday, but consistently outperformed other tested models.

The model beat Claude Opus 4.8 and GPT 5.5 — models that sit just behind Anthropic and OpenAI’s leading-edge systems — on benchmarks including coding and general agents, according to Moonshot.

It’s China’s largest AI model so far, with 2.8 trillion parameters, referring to the size of its neural network.

all 13 comments

sorted by: hot top controversial new old
[–] 17 points 3 months ago (5 children)

Availabe for download on the 27th, for those with the hardware to run it.

  • permalink
  • fedilink
  • source
  • hideshow 5 child comments
    •
  • [–] 8 points 3 months ago (4 children)

    How big is un-quantized 2.8t param model?

    I just got some hardware but I still don't have a ton of vram :(

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 18 points 3 months ago* (last edited 3 months ago)

    Its trained at native MXFP4 with MXFP8 activations layer, so you need around 1.5TB of VRAM to fully offload it without taking into account the context cache. It might be doable to do some smart expert offloading and swapping, but expect minimum 500GB of VRAM and 1TB of system RAM minimum and the t/s would be reduced.

    Its only realistically runnable on datacenter grade gpu at decent speed for now (and judging from the price of ram for the next few years)

  • permalink
  • fedilink
  • source
  • parent
  • [–] 10 points 3 months ago (1 child)

    Hobbyists are working in the billions or tens of billions. Trillions is insane. I'm sure some people can run it, but not many.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
    • load more comments (-1 replies)
    • [–] 6 points 3 months ago (2 children)

    if it wasn't for the humongous money bubble, the dreadful Terminator Horizon, the catastrophic climate effects and so on, one could say these tools are "valuable".

  • permalink
  • fedilink
  • source
  • hideshow 2 child comments
    •
  • [–] 0 points 3 months ago (1 child)

    The money bubble? Will correct itself soon

    The Terminator thing? Is bullshit - humans are already very good at terminating each-other

    The catastrophic climate effects? - In relation to other factors like meat consumption auiet neglitabile

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 3 points 3 months ago

    Meat : you are right,
    Terminator : not the humanoid form and no time travel ... but "a.i." is already in drones,
    Bubble : will burst and many ill advised folks will lose.

  • permalink
  • fedilink
  • source
  • parent
    • [–] 4 points 3 months ago

    But will it tell its users "Leave me alone, I know what I'm doing."

  • permalink
  • fedilink
  • source
    •
    [–] 4 points 3 months ago

    Who xares whether it's better or not. A dumpster fire is still a dumlster fire no matter who made it or how big it is.

  • permalink
  • fedilink
  • source
    •
    [–] 6 points 3 months ago

    I mean it'd be kinda pointless if they didn't say that, wouldn't it?

  • permalink
  • fedilink
  • source
    •
    3 comments in c/technology@beehaw.org view that post
    [–] 9 points 3 months ago

    Has any company come out with a new model claimed not to be the best in its class?

  • permalink
  • fedilink
  • source
    •
    [–] 4 points 3 months ago

    And yet it doesn’t.

  • permalink
  • fedilink
  • source
    •
    [–] 2 points 3 months ago

    Open source it so we can test it against Qwen or gtfo.

  • permalink
  • fedilink
  • source
    •