Crop success should get better as you go south and get directly under the sun -- the panels will cast smaller shadows.

Solar efficiency might get much worse.

In the end, it's a range: you can angle the solar panels not at all, or a little bit, or a lot. The effect on crops will vary and eventually you'll have to stop planting in the persistent shadow of the panels. But perhaps there are lower-light broadleaf vegetables you could plant there.

I'd think east-west bifacial vertical PV makes more sense the further from the equator one gets, simply because of how much wilder the sun angle swings are over the course of a year.

One could of course set up something mechanized to follow the sun over the course of the year, but that's a new point of failure that could easily negate the advantage of agrivoltaics being set-and-forget.