Although maybe "unnattractive" isn't a good fit because I do understand that it's not a woman's default objective to "be attractive" to me.
When you say that something is unattractive , it's your personal opinion which you are entitled to. It's fine. We are people, we are diverse.