Oh, it's not actually FOSS, I think, sorry. Disregard this.

Total Commander is what I use. It's a dual-pane file manager that has support SFTP, WebDAV, SMB and more with the official plugins it has. It sometimes feels a bit dated, but most other file managers I've tried felt simplistic and dumb compared to it. It has lots of advanced features too.