Yes, this is actually very similar to the setup I've had for years - just a RPi to do the STT+TTS part, and hooks in the background to control the right services.