People do have power. That's literally what China does. The assembly holds all the power and there's like 2000 members. So they have a guy be the leader to keep things organised. Xi Jinping doesn't have the power to do whatever he wants he just has the power to guide 2000 people in a room so you don't have 2000 people all arguing over each other.
I agree it's stupid to say "let's give one guy all the power to literally do whatever he wants" but that isn't the case here. You also can't give all the power to someone in countries with term limits. There's checks and balances in place like having a congress or whatever. It's not like countries with new presidents every few years hand over the keys to the entire country and the president can do whatever the fuck he wants like madating everyone who meets him has to suck him off and the only thing that stops him becoming a full blown dictator and declaring that actually there will be no more elections is that humans are stupid and the thought to do that only crosses a presidents mind after 6 years and this is circumvented by replacing him with a new guy before that happens.
Those same checks and balances that exist in other countries also exist in China. Government power exists in the hands of the assembly not the president. Xi Jinping can't do whatever the fuck he wants he just the team leader.
You're just assuming because they don't have term limits that means they give one guy literally all the power and let him do whatever he wants and they all have to listen to him. Again this is the equivalent of seeing the same person at the grocery counter as last week and screaming at them calling them a dictator. When they're just in charge of scanning your items and the same power that put them in charge of that role can take them out of that rule of they start being shit at their job. Well actually this analogy runs thin when you bring up that you can't change who your boss is but that's not my point.