For refference, the HAV unit didn't get a ping after nabu detection. The system froze with one cpu pinned to 100% usage. Screen and observer show that everything is fine. But the dashboard and such is unreachable.

I have now settup assistant completly again, and I think the only difference is "streaming wake word engine = enabled" and I manually force set the assistant in the (esphome) device to the assistant instead of "default". This seems to work again for now...