Prices would get even worse, that's the point.
You also shouldn't assume that if Nvidia exits the consumer market that AMD/Intel would even try to fill the gap. The corporate world is very much trend following, and if Nvidia left entirely AMD/Intel are more likely to decide to follow Nvidia's lead and also exit.