The bottom line rebuttal to all the variants of the "but whatabout people who want to live in single-family houses" arguments is real simple: if it were truly that important to them, then they would be willing to pay fair-market rates for it. Which means artificially inflating the supply (thus subsidizing the price) via restrictive zoning laws wouldn't be necessary.
People who think they are entitled to live in single-family houses to the point that they want the law to forcibly impose that lifestyle on vast swathes of the population are just selfish takers who want society to subsidize them.