because context is a part of language whether you like it or not
The irony of this reasoning is that the things spread as memes you do not think should be called memes because they are not "intended to be funny" are called memes by a vast majority of people on the internet. Making them memes, whether you like it or not.