you are viewing a single comment's thread
view the rest of the comments
[–] [S] 6 points 1 month ago

llama.cpp isn't configured for this mode, there are forks that can work though, this is a good explanation of what's different https://www.youtube.com/watch?v=bcGO7xre46o

  • source
  • parent