If John is anti-anti-swimming, then John is pro-swimming. Clearly he cares enough to think that people should not be prevented from swimming. Therefore he is pro-swimming. He supports and enables swimming. If he was neutral, he would not be anti-anti-swimming or have any other for-against opinion on the matter.
This is not difficult logic to grasp.