Ollama running Llama and Gemma, alongside Whisper for speech recognition, running off a 4070 12GB.

Gemma does not work quite right and probably can't stay, just not quite enough memory even when it's the only model loaded.