While I've found uses for local LLMs (ie I host) and even the bigger chat bots:
I feel the gen "AI" everywhere is just an excuse to collect data since they always use the online models.. And if you are either not paying or paying api rates (per token.. Or usually million token rate) it's basically being provided significantly below cost.