The newer CPU generations come with cores optimized for this stuff (referred to as an NPU). It actually seems to work fairly well for the kind of model you'd run locally.

Barring that, a typical laptop dGPU will also work, although not super efficiently since they often don't exceed 8 GB of VRAM and thus can't run most models without partially offloading them to the CPU.

Of course a laptop with a dGPU and NPU cores will make the offloading less painful. So yeah, workable for most reasonably-sized models.