What about when that person slowly gets into your lane against the wall/road instead of walking straight.

What I do is tailgate them until the last second then suddenly press Nox to pass them on the best side, and bye bye.