I feel like a headwind might be better than a side wind when riding, it makes for harder work but doesn't impact balance as much.

I'm on the edge of a new estate which is surrounded by open fields on three sides and still has a lot of vacant blocks and very little vegetation, so the wind gets extra wild through here too.