I don't think this applies to everyone but the major difference I have found between people who enjoy math and those who don't lies primarily in how they do math. People who don't like math usually learn and reproduce the subject by memorizing formulas and using them as tools to solve problems where as people who enjoy mathematics typically seek to understand why those formulas work and often rederive them. For the former who didn't take the time or was not interested in learning the laws that govern math, the subject is a slog of searching your tool box for the correct tool. Sometimes numerous times until you find the one that works, though often not knowing why it worked and the others did not. For the latter it is like a language they have become fluent in. The indentification of which tool they need has become second nature and they will sometimes design tools specific to their needs.

Edit: I saw all this from my experience as a physics major for most of my undergrad. This primarily comes from what I observed in other physics majors so this could be somewhat skewed info. I'm certain there are people who understood math from the roots up and still hated it. Puzzles like that aren't for everyone and I certainly got tired of it by the time I reached up level math.