Well, plus the Burn that made it difficult to traverse space. The "Klingon Zone" that was hinted at in Discovery probably meant that the apparatus of empire was no longer in place, but that only individual houses remained, scattered wherever they were across the region of the empire.