No, it has multiple connotations, which are completely independent of each other.

The Lolita fashion trend of 90's Japan has nothing to do with the 1950s book. Period.

Just because the words are the same doesn't mean they are directly related to each other

Unless you also think Goth subculture and music genre is related with 3rd century Germanic people or the 12th century architectural style just because they also share the same word.