Holy shit, the idea of enemies that also have deft control over time itself did not even occur to me.
Oh god, that could be baffling to try to concept and balance, oh man, but if you could, dang, and you sound like you've got a simple enough in basic concept, bounded enough... but so many possible things within those bounds...
Run with your idea! I like this!