depends on how you're looking at them, tbh

it makes sense as a straight guy to be attracted to trans women, I don't consider it gay to be attracted to women (though I understand the confusion about this, I assume you're not into trans women who haven't transitioned, presumably you are attracted to women who are feminine and look like women...)

but to be attracted to a trans man definitely raises questions about how you see them. Are you attracted to a trans man like Buck Angel for example, or is it mostly early transition trans men who are androgynous and still might be mistaken for women?