I'd be lying if I said I'd never done this, although usually it's the side of the cupboard. I think if you twist it first, you get a good enough seal that it works well.