I permanently muted the mic on my home max speaker, but still use it for casting music, works well.

I do have a home assistant voice speaker for the timers though