Sure you can have a unique identifier. That’s not the issue. The issue is that anyone can contact you via your phone number! This is not a problem with chat apps where people need permission to add you to their contact list. Why not have a system like that?
Same goes for credit cards. They should need to ask for permission to charge your credit card. Merely knowing your credit card info should not be enough.