You talk about residue getting cleaned away, but without soap, that will not be effective.

As for wiping down toilet seat, depends. My own home, no. Outside, toilet paper and sanitiser.

It is a different level of risk when something touches skin compared to contact with an orifice.

Separate bidets don't concern me like integrated ones inside a toilet as contamination risk is much less.