This doesn't make utilities cheaper. Utility prices are almost universally set, in one way or another, by the government. If the government wants to lower utility prices, they can do so easily by just voting.

This ignores the issue of how we actually pay for the actual cost of utilities. That's a whole other thing. But long story short - NO, you should not expect utility prices to come down if your government builds solar capacity.