Socialist society, where humans collectively own production, cannot be dictated by a single or small group. It requires mass participation.
Do you really think this could work in a city for example where many people live together, not knowing each other? What you say could be possible in a small village where only a hundred people live together but when it exceeds more than 500, it'd impossible IMO and it would always turn into what we have right now.