You'd think that that's the one thing LLMs should be good at – have characters respond to arbitrary input in-character according to the game state. Unfortunately, restricting output to match the game state is mathematically impossible with LLMs; hallucinations are inevitable and can cause characters to randomly start lying or talking about things thy can't know about. Plus, LLMs are very heavy on resources.
There are non-generative AI techniques that could be interesting for games, of course; especially ones that can afford to run at a slower pace like seconds or tens of seconds. For example, something that makes characters dynamically adapt their medium-term action plan to the situation every once in a while could work well. But I don't think we're going to see useful AI-driven dialogue anytime soon.