Interesting, thank you for the response. I've never really thought about it, but I think I often say it in that context as an additional indicator of respect for the deceased. I simply don't consider the deaths of people I don't care for to be unfortunate, while obviously the inverse is true for those I do.
Guess I'll have to contemplate on whether I should continue that habit if it implies some sinister meaning to some. I honestly doubt I'll change it as it's too ingrained at this point in my life, but if it causes too many to read darkly into it then maybe...