If this was speed, there would be points of negative speed, when height is lower at a greater time.

there is no need for the height axis to start below zero just because there is negative speed at some point. i am going to assume you are just dumb, because i do believe people can be that dumb.