Probably if you move Caddy to the local VM and then forward the ports 80 and 443 to the VPS through WG. So the VPS receives all requests, but instead of going through Caddy first and then through WG, they go straight through WG and into Caddy on your local VM. Then you can access Caddy both locally and externally through the VPS-WG tunnel.
I have no experience setting this up though, I don't have a VPS in front of my lab.