My man, you're speaking sci fi, not what we currently have.
The biggest of current LLM models contains ~ the same number of parameters as we have neurons. It's not a 1:1 mapping because parameters are closer to neuronal connections, but from a pure numbers standpoint we are operating at the scale where we can start creating true simulated intelligences, even if not human scale just yet.
This doesn't mean current LLMs are that intelligent, just that it's not sci-fi to think we could create a simulated intelligence now.
Furthermore, both philosophically and materially, the notion that consciousness cannot be computed is more than gaining traction.
Is it? Do you have any sources / do they have any explanation for why neurons can't be simulated?
If humans ever make something with free will and volition, something that isn't just doing things on command but has its own wants, sure. But we might never get there, and that's a real possibility. Intelligence isn't in solving equations but in imagining the math problems.
I mean, we're talking about whether or not an AI could make music. If it creates a new song, with lyrics and music / a melody that never existed before, and people listen to it and sing it and dance to it and enjoy it, how would it not be music?