As a 50+ yo that cut contact with his parents decades ago, I know that you can most definitely move out. I am aware that many of my negative behaviors were formed in my early years due in large part to my upbringing but there came a point in my life where I was aware they were due in totality to me choosing to continue those behaviors. Although I will never be confused with a saint, I'm a much better person and my choices in how I behave have absolutely nothing to do with my upbringing. The old building with the bad foundation hasn't been part of my life for decades.
The analogy is the embodiment of victim mentality, meant to help a person feel powerless regarding why they make poor choices. Staying in that building is a choice each person makes. It's not a prison.