I’m all for local models, but if you don’t have a giant computer, pay a few bucks for a no log API like Cerebras API. Or any company, in any jurisdiction; take your pick.
But you can use them with any number of chat front ends, including easily self hostable ones.
Obviously the caveat for sending anything over the internet or “trusting” a cloud business applies, but we’re talking about inference-only companies that mostly host open LLMs for other businesses to use; you aren’t their product. They don’t do any training, and their business isn’t invading your privacy.