That's not entirely true, unless you choose to nixify everything. You can just have a basic Nix configuration that installs whatever programs you need, then use stow (or whatever symlink manager you prefer) to manage the rest of your config.
You can't entirely forget that you're on NixOS because of FHS noncompliance but even then getting nix-ld to work doesn't require a lot of effort.