Jamba is a killer model flying under the radar, though it does have a quirk I more recently discovered: no prompt caching in llama.cpp (yet).

If you have a 24GB GPU you can cram Nemotron 49B in it with no offloading, including the new reasoning version. It’s a monster at STEM stuff, and I can upload my special quantization (3bpw, with 4bpw KV heads, exllamav3) if you ask.

Qwen 30B coder is ridiculously fast for how smart it is at coding, just came out today…

TBH the last week or two has been nuts with new releases.

But FYI if you are looking for pure prose quality, I still use EVA Gutenberg 32B (based on Qwen 2.5 base) and Jonboro's brand new QWQ 32B fine tune, as new models have not surpassed them IMO. But for creative writing, I tend to write novel style instead of multi turn, so YMMV.