I don't know about the UK, but I was taught that US slave owners would do collective punishments if any slave kids were caught swimming.

Swimming is a super power if you're running from dogs, because dogs lose he scent when you cross a river.

Also, a lot of US public swimming pools were destroyed by the local governments when racial segregation was banned.