As a counter point, the window has shifted with some fashion. Sneakers used to be informal only, whereas they can now be a part of formal outfits too
Nice sneakers + a dress for example
I think we're always going to see an association between expensive clothing (clothing that is hard to acquire and care for) and formal events. The same way we might save a good food item for a special meal, etc