▲ 168 ▼ 'Consider a system with no DRAM' replaced by a 'recycling fiber loop': John Carmack envisages bold future to avoid AI-driven RAM crisis (www.techradar.com) submitted 8 months ago by tal@lemmy.today to c/technology@lemmy.world 52 comments fedilink hide all child comments
[–] Shadow@lemmy.ca 17 points 8 months ago (3 children) https://en.wikipedia.org/wiki/Delay-line_memory permalink fedilink source parent hideshow 3 child comments replies: [–] nova_ad_vitum@lemmy.ca 10 points 8 months ago (1 child) The lack of investment in more production capacity for RAM is based on a roughly 3-year horizon for this insane extra AI demand. Creating workable consumer-grade alternatives with delay line memory of all things would take longer than that, and the market would collapse the moment AI demand for RAM dried up. This is one of those things that is theoretically possible but due to both technology and market conditions will absolutely not be a thing. permalink fedilink source parent hideshow 1 child comment replies: [–] tal@lemmy.today [S] 15 points 8 months ago Creating workable consumer-grade alternatives I think that this is intended not to replace DIMMs in PCs, but to replace HBM for AI use. If you're doing neural net computation, you have very predictable access patterns, so you can store your edge weights such that the desired data is showing up at just the right time. permalink fedilink source parent [+] just_another_person@lemmy.world -7 points 8 months ago It's not that we don't know what it is, it, again, is just INCREDIBLY FUCKING STUPID. permalink fedilink source parent
[–] nova_ad_vitum@lemmy.ca 10 points 8 months ago (1 child) The lack of investment in more production capacity for RAM is based on a roughly 3-year horizon for this insane extra AI demand. Creating workable consumer-grade alternatives with delay line memory of all things would take longer than that, and the market would collapse the moment AI demand for RAM dried up. This is one of those things that is theoretically possible but due to both technology and market conditions will absolutely not be a thing. permalink fedilink source parent hideshow 1 child comment replies: [–] tal@lemmy.today [S] 15 points 8 months ago Creating workable consumer-grade alternatives I think that this is intended not to replace DIMMs in PCs, but to replace HBM for AI use. If you're doing neural net computation, you have very predictable access patterns, so you can store your edge weights such that the desired data is showing up at just the right time. permalink fedilink source parent
[–] tal@lemmy.today [S] 15 points 8 months ago Creating workable consumer-grade alternatives I think that this is intended not to replace DIMMs in PCs, but to replace HBM for AI use. If you're doing neural net computation, you have very predictable access patterns, so you can store your edge weights such that the desired data is showing up at just the right time. permalink fedilink source parent
[+] just_another_person@lemmy.world -7 points 8 months ago It's not that we don't know what it is, it, again, is just INCREDIBLY FUCKING STUPID. permalink fedilink source parent