I got this working for the time being by using rustdesk (even though rustdesk isn't supported fully on Wayland but already works for me)
Since I already had tailscale,I can even connect to devices on different networks.
Setup one time password on rustdesk and it works eveytime.