Uh, why can't it be relative to the Earth's surface? We're already trapped in that gravity well after all, we don't drift off it because of normal time travel in real time.