It's likely the only reason for the privilege is to collect coords to send to the weather API. At least it's optional, and there are alternative ways to see weather reports, just not on the home screen.

I tried accessing Google Photos via my phone to handle a couple of things I had active on that account from before. Little fuck refused to let me open the app unless it had unconditional access to all my media.