Yes, but they are qualia BECAUSE language is flawed and cannot properly convey the sensation that you experience as joy. Again, a qualia is a weakness of language. If we could suddenly communicate psychically, and send the exact experience, it ceases to be a qualia.
There is no combination of words that can cause an LLM to feel. They fundamentally do not have the ability. They are a mathematical equation that takes language in, and spits language out. There is nothing in the middle of that process except math. Even the randomness is an added parameter. You could seed that randomness, and the same seed would produce the same exact response. It does not understand what you're passing in, or what it's spitting out. It's completing a formula. It's a calculator.