358
China solves 'century-old problem' with new analog chip that is 1,000 times faster than high-end Nvidia GPUs (www.livescience.com)
submitted 1 year ago by to c/technology@lemmy.world
118 comments fedilink hide all child comments
 

"The new device is built from arrays of resistive random-access memory (RRAM) cells.... The team was able to combine the speed of analog computation with the accuracy normally associated with digital processing. Crucially, the chip was manufactured using a commercial production process, meaning it could potentially be mass-produced."

Article is based on this paper: https://www.nature.com/articles/s41928-025-01477-0

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 1 year ago

@Treczoks @flemtone Thing is, the final LLM inference is usually done at reduced precision. 8-16 bits usually, but even 4bits or lower with different layers of varying precision.

  • permalink
  • fedilink
  • source
  • parent