You can, if you create an empty file at /etc/apt/break-my-system first. It's intentionally not mentioned to prevent another Linus situation

In my experience, Linux only allows you to do 1 incredibly stupid thing at a time. Remove sudo? Cool. Remove apt? You betcha. Remove apt AND sudo? You're fucking nuts, I ain't doing that

You could always try using "sudo dpkg -r --force-all apt" instead. It won't clean up the dependencies, admittedly.