I was under the impression that there is in fact such a thing as a complete mathematical system (if you take "mathematical system" in the broader sense of "internally consistent system"), but such a system would be pretty limited and therefore rather useless.