So many of the complaints I see about LLM behaviour can be so easily solved by just adding "don't behave this way" to the prompt. Most LLM frameworks these days let you add stuff like that to the default system prompt so you don't even have to remember to do it.