The thing is they aren't going up evenly everywhere. A $400,000 house from a few years back in my area is now selling for $600,000, but a $100,000 house from that same time is now selling for $300,000. So the price difference between the 2 has actually stayed the same.
The institutional investors are targeting the cheaper houses, so they're the ones skyrocketing the most in value.