LLMs themselves don't, but an external memory system that it reads/writes to might or if someone is reading the chats. But running LLMs locally can be very private.