Because we are all still inherently insecure social animals that have been trained by society to value ourselves based upon how we think others see us. It's a losing proposition because it puts control over your emotional well-being almost entirely in the hands of other people - the large majority of which are too self-absorbed to put you first.
If you were to blame in any way, then it's most likely for not believing in yourself enough for him to take you seriously. He knew you were dependent upon him for your self-worth, so he knew he didn't have to do anything to earn your affection. It's kind of hard to view someone as worthwhile when they don't even see themselves that way.
You need to respect yourself first and foremost before anyone else can be expected to do the same. Stop looking for validation from others, and start knowing that you are a good person worthy of respect. Anyone who doesn't see that within you can go take a flying leap & ultimately probably isn't someone worth worrying about.