Craft stores sell glass(*) etching cream that will absolutely do this (to the types of glass I've used it on). Unless there is some super specific chemistry to windshield glass, a jar of that should work.

Edit: spelling