Avoiding Plex for something like Jellyfin is a start.
Past that, it doesn't take a lot to run such a service unless it needs transcoding which is where it gets dicey for realtime streaming.
If you have a standard expected output you might get away with bulk stranscoding ahead of time and then run things on some little nuc or an old laptop.