One Linux you could, I.E. for a flatpak you could use flatseal (or manually do it via command line) to lock down what folders the flatpak can operate in. I just did this for Brave Browser.

There is also the software Bubblewrap that accomplishes the same. These are at the application level for the entire browser though.