Purgatory isn't a place, it's a process. You go through purgatory, not to purgatory. It also helps to think of the afterlife as more of a state than a place, existing outside of time.