That's why you would keep the randomness of the dice, but isolate it. It's easy to trust a DM to be reasonable when it comes to some things, but the randomness is useful in making the play more interesting, and people aren't great at creating statistically distributed randomness. And if your DM is just looking at the die and saying, 'yah' or 'nah,' they shouldn't be your DM. If your players can't handle being told their characters' attack didn't land, they aren't ready to play the game. It isn't possible to win or lose DnD, but it's absolutely possible to succeed or fail to play.
And you wouldn't be removing the mechanical elements, such as the smite, just putting player focus on the diegetic space. They can still smite, but with their attention spent on thinking about the righteous smash of their weapon against the enemy's armour and less on going 'okay, then we carry the one, and...'