Do you have kids? "Because I said so" doesn't usually come out of nowhere. It's a response of frustration, usually because that conversation has been had multiple times already.