If pollinators weren't necessary, human food wouldn't be affected too much. But given we eat plants (and the animals we eat eat plants) hunter-gathering would have the same problem as just continuing farming. Can't gather if there are no plants, can't hunt if the prey starved to death.