At least llama.cpp doesn't seem to do that by default. If it overruns the context window it just blorps.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
replies:
At least llama.cpp doesn't seem to do that by default. If it overruns the context window it just blorps.