Is it though? There's the whole causality argument, where if time travel does get invented in the future, then you can only travel back to that moment