First commit 2 days ago
post
replies:
or just use llama.cpp
replies:
permalink
fedilink
source
parent
llama.cpp isn't configured for this mode, there are forks that can work though, this is a good explanation of what's different https://www.youtube.com/watch?v=bcGO7xre46o
all 9 comments