That's exactly what I'm doing as well. Got my VM set up, HAOS installed and bluetooth up and running. Now I'm starting to add my stuff already in my house and I'm looking for good ways to do it. I've also added it to tailscale and can access it from my phone.
It's SOOOO much faster than the Pi.