you are viewing a single comment's thread
view the rest of the comments
[+] [S] 2 points 7 months ago (5 children)
  • [–] 2 points 7 months ago* (last edited 7 months ago)

    Problem with smaller footprint is cooling and how audible it becomes.
    One idea is to use fiber optic hdmi cables and a usb extender to hide the pc away in another room.

    If you want smaller footprint then the keyword to use is "Unified memory", it can be reasonable fast for 30B models and a slow thinker mode for 70B ones.

    edit: example of a Unified Memory Apple Mac Studio can be found here at $5499 for 96GB RAM
    https://www.apple.com/shop/buy-mac/mac-studio/m3-ultra-chip-32-core-cpu-80-core-gpu-96gb-memory-2tb-storage

  • source
  • parent
  • [–] 2 points 7 months ago (2 children)

    If you happy with 16g , nothing can beat in speed/cost of AMD RX 9070 XT.

  • source
  • parent
  • hideshow 2 child comments