That's one of the big things. Oftentimes you must do some searching to find a ride/location that fits your needs. There are all kind of forums and collectives to lower the barrier of entry for that. But you can always design your own ride by finding a national forest or state park with a bunch of gravel trails and parking up at the top and biking back into the game lands or park. More than I can realistically put in a comment here but it's a whole thing.

I want to stress that there's a high ceiling for making an interesting specifically tailored trip, but there's also a pretty low interest threshold of just going to a place and making it happen.