Crop success should get better as you go south and get directly under the sun -- the panels will cast smaller shadows.
Solar efficiency might get much worse.
In the end, it's a range: you can angle the solar panels not at all, or a little bit, or a lot. The effect on crops will vary and eventually you'll have to stop planting in the persistent shadow of the panels. But perhaps there are lower-light broadleaf vegetables you could plant there.