First, as I said, I remapped ESC to TAB key. Tab is very close.
Second, it's different to hit ESC ones than to use arrows keys to move around. To go back to home row after using arrow keys I have to feel around the keys trying to find "j" again. Or look at keyboard. I don't have to do that after hitting ESC once.