The robots are there to replace the apologetic delivery driver, not the rich asshole. They'd never let that happen.
Bots can just as easily be programmed with an address blacklist. At least a delivery driver with a spine could choose to ignore that list, if his livelihood wasn't on the line...