It doesn't even take lengthy observation most of the time. Most people are bad at concealing that they have a gun, especially in a way where moving doesn't make it obvious. There is also the issue that the better something is concealed the slower it is to pull, and more obvious it is you are trying to access it.