Used to work in the area, and saw 40 Wall Street at least once a day.
The ground floor shop was empty for years. Remember, this is one of the most crowded areas in the most crowded city in the USA. During the day, there wasn't a shop that didn't have a line.
I don't know who he annoyed, or what legal nonsense was going on, but that place had at least 50,000 people walking by it every day.