Just stealth once you're properly out of sight.

Its hard to lose a guard that's already seen you with stealth but when you've put enough distance between them so that you can stealth and stay completely still it drops pretty quickly, and then they head back to their routine.

Invisibility helps a lot, chameleon less so after being seen, but they just don't really lose you if you never crouch back down after getting unseen.