need 64gb of system ram. qwen next architecture uses smaller experts than others, and it can keep up with ram swap. I believe it uses a file on disk (ngram) to predict what experts will be needed.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments