Just build over it in the proper direction or look in your game settings for the controls?

When you build and drag in any directionele the belt direction is adjusted automatically.