I don't think Ventoy would be the limiter there. It sounds to me like its the live distro version. Those can be restricted to running a few apps and being used to install the full version. Often things like hotplug devices don't work too well with live distros.
If the system is primarily going to be a server, I'd recommend Debian, but I'm definitely biased. It's stable, well supported, and documented. I normally install it with the Cinnamon desktop (just in case) and ssh server, and nothing else, then add what I need manually as I go. As a lot of folks in the comments mentioned, the biggest issue with the "stable" distros is that they stay stable by long delaying integrating new modules and drivers. Fantastic for a server, not so great for gaming rigs that are going to need the latest software, fixes, and developments.
My issue with Bazzite, even on a rig that was going to be primarily for gaming was anything else I wanted to do that was not just gaming. You can't install software from .rpm. I tried making some changes to .conf files via command line (using sudo and root) and was denied, so I just noped my way to Nobara. I'm still recommending Bazzite to a friend who also mostly games on his PC. He's not nearly as techie, doesn't have a complicated home network, and just needs something that will plug and play and let him game. And from my perspective as the person he'll call if something doesn't work, if it prevents him from breaking things, EVEN BETTER. xD