NFS is the best option if you only need to access the shared drives over your LAN. If you want to mount them over the internet, there's SSHFS.
post
If you already know NFS and it works for you, why change it? As long as you’re keeping it between Linux machines on the LAN, I see nothing wrong with NFS.
Isn’t nfs pretty much completely insecure unless you turn on nfs4 with Kerberos? The fact that that is such a pain in the ass is what keeps me from it. It is fine for read-only though.
If you’ve got Tailscale it’ll build WireGuard tunnels directly over the LAN: I actually do this with Samba for Time Machine backups on macOS.
Obviously the big bonus is being able to do the same over the internet without the gaping security holes.
(I used to use split DNS so that my LAN’s router’s DNS server returned the LAN IP, and Tailscale’s DNS server returned the Tailscale IP. But because I’m a privacy geek I decided to make it Tailscale-only.)
Would be fine for designated storage networks that use IP whitelists.
Other than that, you kind of need user specific encryption/segregation (which I beliege Kerberos does?)
It is, but nfsv3 is extremely easy to configure. You need to edit 1 line in 1 file and it's ready to go.
NFS is still the standard. Were slowly seeing better adoption of VFS for things like hypervisors.
Otherwise something like SFTPgo or Copyparty if you want a solution that supports pretty much every protocol.
I think a reasonable quorum already said this, but NFS is still good. My only complaint is it isn't quite as user-mountable as some other systems.
So...I know you said no SAMBA, but SAMBA 4 really isn't bad any more. At least, not nearly as shit as it was.
If you want a easily mountable filesystem for users (e.g. network discovery/etc.) it's pretty tolerable.
NFS is still useful. We use it in production systems now. If it ain’t broke, don’t fix it.
And if you have a dedicated system for this, I’d look into TrueNAS Scale.
Truenas Scale works well as long as you don't want any dockers on it. Once you want to run docker images it is easier to install a VM on Truenas and run the docker from there than it is to try to set up custom "Apps"
Wut? I've got a bunch of dockerhub images running on a scale box
I'd use an s3 bucket with s3fs. Since you want to host it yourself, Minio is the open-source tool to use instead of s3.
If it's for backup, zfs and btrfs can send incremental diffs quite efficiently (but of course you'll have to use those on both ends).
Otherwise, both NFS and SMB are certainly viable.
I tried both but TBH I ended up just using SSHFS because I don't care about becoming and NFS/SMB admin.
NFS and SMB are easy enough to setup, but then when you try to do user-level authentication... they aren't as easy anymore.
Since I'm already managing SSH keys all over my machines, I feel like SSHFS makes much more sense for me.
I still use sshfs. I can't be bothered to set up anything else I just want something that works out of the box.
Isn't that super clunky ? I keep getting all kind of sluggishness, hangs and the occasional error every time I use that. It ends up working but wow, does it suck.
I mostly use samba / cifs clients and it's fast and reliable with properly setup dns and using only the dns or IP address, not smbios or active directory those are overkill
I like the sound of that!
However it looks like has a lot of potential for a 'xz' style exploit injection, so I'll probably skip it.
From the project's README.md : The current maintainer continues to apply pull requests and makes regular releases, but unfortunately has no capacity to do any development beyond addressing high-impact issues. When reporting bugs, please understand that unless you are including a pull request or are reporting a critical issue, you will probably not get a response.
NFS is really good inside a LAN, just use 4.x (preferably 4.2) which is quite a bit better than 2.x/3.x. It makes file sharing super easy, does good caching and efficient sync. I use it for almost all of my Docker and Kubernetes clusters to allow files to be hosted on a NAS and sync the files among the cluster. NFS is great at keeping servers on a LAN or tight WAN in sync in near real time.
What it isn't is a backup system or a periodic sync application and it's often when people try to use it that way that they get frustrated. It isn't going to be as efficient in the cloud if the servers are widely spaced across the internet. Sync things to a central location like a NAS with NFS and then backups or syncs across wider WANs and the internet should be done with other tech that is better with periodic, larger, slower transactions for applications that can tolerate being out of sync for short periods.
The only real problem I often see in the real world is Windows and Samba (sometimes referred to as CIFS) shares trying to sync the same files as NFS shares because Windows doesn't support NFS out of the box and so file locking doesn't work properly. Samba/CIFS has some advantages like user authentication tied to active directory out of the box as well as working out of the box on Windows (although older windows doesn't support versions of Samba that are secure), so if I need to give a user access to log into a share from within a LAN (or over VPN) from any device to manually pull files, I use that instead. But for my own machines I just set up NFS clients to sync.
One caveat is if you're using this for workstations or other devices that frequently reboot and/or need to be used offline from the LAN. Either don't mount the shares on boot, or take the time to set it up properly. By default I see a lot of people get frustrated that it takes a long time to boot because the mount is set as a prerequisite for completing the boot with the way some guides tell you to set it up. It's not an NFS issue; it's more of a grub and systemd (or most equivalents) being a pain to configure properly and boot systems making the default assumption that a mount that's configured on boot is necessary for the boot to complete.
Thanks for that caveat. I could definitely see myself falling into that
Yeah, it's easy enough to configure it properly, I have it set up on all of my servers and my laptop to treat it as a network mount, not a local one, and to try to connect on boot, but not require it. But it took me a while to understand what it was doing to even look for a solution. So, hopefully that saves you time. 🙂
The fact that you say using NFS makes you old makes me feel like fucking Yoda
I can't decide if I'm happy or disappointed that no one suggested I make a Beyowolf cluster.
I still have to use SAMBA as Win 11 hates NFS with a passion and we have Win 11 boxes here supplied as work machines so no changing. Also wifeys gaming rig is Windows as she don't want to mess around getting stuff to work...
But hey - for everything else it is NFS with all of its weirdness, but it just works a bit better than SMB
My Windows machines seem to be just fine with the couple of NFS shares I use for easier cross-platform mounting on boot. It comes at the cost of some security, though, so I use it to share unimportant stuff I want to mount very freely, like some media libraries. I use SMB for the rest.
I'm curious, what's the issue with NFS on Windows for you?
Oh it just doesn't like it as much as SMB... has work mandated VPN on it for starters! I use a truenas box for most of the backups etc. and I just share the same dataset via SMB and NFS and locally only, so it is sorted, but NFS on the Win 11 box is just way flakier and drops often
For smaller folders I like using syncthing, that way it's like having multiple updated backups
Syncthing is neat, but you shouldn't consider it to be a backup solution. If you accidentally delete or modify a file on one machine, it'll happily propagate that change to all other machines.
You can turn off "delete", but modification is a danger, it's true.
Turning off delete makes it excellent for eg. backing up photographs on your phone. I've got it doing this from my Android to my raspberry pi, which puts them on my NAS for me. Saves losing all my pictures if I lose my phone.
I like this solution because I can have the need filled without a central server. I use old-fashioned offline backups for my low-churn, bulk data, and SyncThing for everything else to be eventually consistent everywhere.
If my data was big enough so as to require dedicated storage though, I'd probably go with TrueNAS.
For linux only, lan only shared drive NFS is probably the easiest you'll get, it's made for that usecase.
If you want more of a dropbox/onedrive/google drive experience, Syncthing is really cool too, but that's a whole other architecture qhere you have an actual copy on all machines.
truenas is cool. I've only used core so far, but i hear scale is taking over
this looks promising. Seems a little heavy-weight at first glance... How was it to get up and running?
It's heavy and it doesn't like if you tinker with the box in Non-TrueNAS ways. In the end it's a convenient shiny gui for ZFS and NFS. But it (or ZFS) needs some RAM (minimum 8 I think), so I'm not sure about it working on your old laptop.
the GUI makes it pretty painless. it was my first real attempt at self hosting anything, my first experience with any kind of NFS/SMB setup at all. i was running it as bare metal for around 2 years before using installing as a vm on proxmox.
I use NFS for linking VMs and Docker containers to my file server. Haven't tried it for desktop usage, but I imagine it would work similarly.
LAN or internet?
Https is king for internet protocols.
LAN only. I may set up a VPN connection one day but it's not currently a priority. (edited post to reflect)
For all its flaws and mess, NFS is still pretty good and used in production.
I still use NFS to file share to my VMs because it still significantly outperforms virtiofs, and obviously network is a local bridge so latency is non-existent.
The thing with rsync is that it's designed to quickly compute the least amount of data transfer to sync over a remote (possibly high latency) link. So when it comes to backups, it's literally designed to do that easily.
The only cool new alternative I can think of is, use btrfs or ZFS and btrfs/zfs send | ssh backup btrfs/zfs recv which is the most efficient and reliable way to backup, because the filesystem is aware of exactly what changed and can send exactly that set of changes. And obviously all special attributes are carried over, hardlinks, ACLs, SELinux contexts, etc.
The problem with backups over any kind of network share is that if you're gonna use rsync anyway, the latency will be horrible and take forever.
Of course you can also mix multiple things: rsync laptop to server periodically, then mount the server's backup directory locally so you can easily browse and access older stuff.
Stick with NFS, and use e.g. rsync for backup. Or subversion, if you want to be super-safe.
Sounds like NFS might still be the way to go for you.
For backups personally I use Restic and connect over SFTP via SSH, since that's just built in and doesn't need any configuration.
For more traditional file sharing I use WebDAV with SFTPGo, since I need windows and android compatibility too, and webdav is pretty easy to setup and use.
And I also use Syncthing for keeping some directories in sync between devices.
I have SFTPgo in a docker container with attached storage. Can access it through many protocols, but on linux I mount it via WebDav.
Whats neat is that I can also share files/folders with either other registered users or with a password or download only link and it has a web gui for that.
I use a samba mount behind a VPN.
TrueNas is pretty top notch and offers a variety of storage and protocol options. If you're at all familiar with Linux style OS, it should be pretty easy to work with. Setting up storage comes with a little bit of a learning curve, but it's not too bad. This SAN/NAS OS is polished, performant, and extensible. If you're not planning on using SMB or Samba, you can most certainly use NFS, or iSCSI if that's your thing.
Everyone forgets about WebDAV.
It's a little jank, but it does work on Windows. If you copy a file in, it doesn't show up in the file manager until you refresh. But it works.
It's also multithreaded, which isn't the case for SMB. This is especially good if you host it on SSDs.
Check out SyncThing, which can sync a folder of your choice across all 3 devices
[edit] oops, just saw you don't plan on using it
In that case, if you use KDE, you can use Dolphin to set up network drives to your local network machines through SSH
So, I understand this is Ian only, I will leave out NextCloud.
I would personally say Ceph. This is a storage solution meant to be spread among a bunch of different hosts. Basically, it operates on RAID 5 principles AND replicated storage.
Personal setup: single host 12 ea. 10TB HDDs.
To start, it does go ahead and generates the parity data for the storage bucket. On top of that, I am running a X2 replicated bucket. Now since I am running a single host, this data is replicated amongst OSDs(read HDDs), but in a multiple host cluster it would be replicated amongst multiple hosts instead.
One of the benefits to an array like this is that other types of services are easily implemented. NFS overall is pretty good, and it is possible to implement that through the UI or command line. I understand that Samba is not your favorite, but that is also possible. Personally, I am using Rados to connect my Apache Cloudstack hypervisor.
I will admit, it is not the easiest to set up, but using docker containers to manage storage is an interesting concept. On top of that, you can designate different HDDs to different pools, perhaps you want your solid state storage to be shared separately. Ceph is also capable of monitoring your HDDs with smartctl.
Proper installation does give you a web UI to manage it, if some one of your skill even needs it. ;)
I use both samba and NFS (with freebsd) on the same disk for my freebsd, linux and win7 desktop machine. All works perfectly fine.
I'm running an rsync daemon for large transfers and use copyparty for easily grabbing files on phones etc.
all 80 comments