Math is the philosophy department in that math is an extension of logic, which is in turn an extension of philosophy. You'd have a better chance of divorcing math from applied math (engineering/physics) than separating math from philosophy.