If I recall correctly, he's talking about just advanced life. Habitable planets is its own category, and honestly tends to be squeezed into assumed parameters for what we know is possible, aka Earth. We've had those lines pushed before, when we found life in ocean trenches that we didn't think would be "habitable".
But his theory on the (small) window of time for life to evolve to advanced forms and intelligence for most stars was mind blowing to me. The only counter that works against it for all places is the number of chances it has to happen in different varieties in just this galaxy, not to mention the millions of others out there. We may never contact anyone else, but to think that with an average star's life and a number of steps back we still got to where we are and yet it never happened anywhere else is very egocentric, almost as much as the old models where everything goes around the Earth.
Did it happen in this section of the galaxy? He may be right enough that no, it's only a few in this galaxy, somewhere. And there's the problem of distance again. So we might as well be along, without some new discovery to get past the speed of light.