If you already received your item(s) and you don't immediately need to do any more business with them, it sounds like they don't have a lot of leverage to get you to pay.

Sounds like that might have been a screw up on their part.