System Restore can help. Some applications will kick off a restore point before installing but you can preempt that by grabbing one yourself. Microsoft support page

I’ve also had success with the portable and free version of Revo Uninstaller. It does the cleanup after the application has already been installed, so there is a chance it may miss something. Revo Uninstaller page

Hope this gets you pointed in the right direction

If your goal is to document changes to a system, something like RegShot is a useful tool for this type of thing. There is also WhatChanged but development of that tool seems to be dead.