Based on the attempts we've seen at censoring AI output so far, there doesn't seem to me to be a way to actually do this without building a new model with pre-censored training data.

Sure they can tune models, but even "MechaHitler" Grok was still giving some "woke" answers on occasion. I don't see how this doesn't either destroy AI's "usefulness" (not that there's any usefulness there to begin with) or cost so much to implement that investors pull out because none of the AI companies are profitable, and throwing billions more to sift through and filter the training data pushes profitability even further away (if censoring all the training data is even possible at all).

No. You would use a base model (GPT-4o) to get a reliable language model to which you would add a set of rules that the chat bot follows. Every company has its own rules, it is already widely in use to add data like company-specific manuals and support documents. Not rocketscience at all.