Fortunately, this fucking windows partition I only keep for VR with my shitty Oculus Rift CV1 reminds me how fucked up the alternative is. I can't fucking wait to get a Steam Frame and ditch it.
This is, specifically, the workflow for changing graphics cards manufacturers on windows, e.g. nVidia to AMD. If you're just going from one AMD card to another, or vice versa, generally you can just toss it in and reboot a few times, yes.
GPU manufacturers are fucking awful about actually uninstalling their bloatware shit on windows, and it often (potentially intentionally) interferes with other manufacturer's drivers (and sometimes their own, though that's less common these days.)