Why won't you feel sympathy for someone who's hurting? Why do you feel that someone needs to fall into a very narrow category to be "worth your time"?
Just because someone doesn't fall into your narrow view of what's worthwhile doesn't mean they're not worth basic human compassion.