You also change the rate at which you move forward in time depending on the local gravity and speed.

It is technically possible to accelerate so much you can travel forward in time at a nearly infinite rate.

You just can't go backwards in time.