criminals don't feel they MUST have a gun to defend from the police
Criminals know that they won't win a gunfight against the police. Instead they always flee, and if they're caught often have their guns on them or in their vehicle.
Most criminals in the US who carry guns do so to kill rival criminals. The police or law-abiding civilians being disarmed wouldn't change that.