Minor correction, the Spanish crown objected to him enslaving Christians which is a major violation of Canonical Law. They would have been fine had he enslaved them but after making them Christian subjects of Spain it was a bridge too far.