It's happened twice now. I figure I maybe didn't tighten it enough last time so I went a bit harder this time. Any idea if something else might be wrong? My complete amateur theory is that the hard water buildup is making everything stiff down there, so that rotating the faucet also rotates this piece.

Thanks for your help!