A well organized drawer or cabinet should still be O(1). It takes at least 2 more steps, assuming you don't leave them open all the time, but the number of operations doesn't change depending on the number of clothing items you need to retrieve.

A pile of clothes is faster, but only for a small number of items. As the number of articles pile up, they hide older items and need to be pushed side before the intended article can be found and then retrieved. This is now O(N), and less efficient than just storing things in the proper place...