Honeybees destroy ecosystems because they're more efficient at pollination than wild bees are, so there's an ecological nuance to abstaining from honey. Apart from that, there's the ethical component of taking away food that the bees produce for themselves that's not ours for the taking.