So Wolf 359 took place in 2367 and Voyager starts to kill them in 2378. If they doubled in that time then the Borg would have expanded into many of those species independent of any Alpha Quadrant chicanery.
Humans however, seem purpose built to beat the Borg. They seem like the only species that can recover from assimilation and have the basic engineering taught by the Academy to soft counter Borg tech. Star Fleet tech also seems to be the only technology that is so infinitely flexible with calibrations and frequency changes. And the Borg doesn't encounter this with 10,000 other species? Incredible.