I got this working for the time being by using rustdesk (even though rustdesk isn't supported fully on Wayland but already works for me) 

Since I already had tailscale,I can even connect to devices on different networks.

Setup one time password on rustdesk and it works eveytime.

Yeah I should also start meditating