You don't need to confess that any more than you need to confess that sometimes you eat food.
An even more direct comparison is confessing that you don't like spicy food and eat mild food. People will shame others over considering food too spicy, but simultaneously enjoying spicy food is completely legitimate itself.