100% agree with you. Straight people can hate gay people because they are assholes, not because they are secretly gay.
Here is an article you might want to read. I keep it on my Mastodon account to grab real quick.
https://newhumanist.org.uk/articles/the-dangerous-stereotype-of-the-self-hating-homophobe/