I'd put it more like people can't take one day to go vote (two if we count primaries).

Like you said- people aren't making this grand sacrifice and it's foolish to expect them to, especially given the sacrifice is far, far greater.