If you pay nothing, the payment provider actually paid, and they get the refund. If you paid double, then the merchant still only got paid once, and you get that share back.