If you’re having an unlimited number of rolls prior to your “real” roll

You'd end up with a perfectly smooth D20 which would never stop rolling, assuming it was rolled in a vacuum.