Server to TV should be local, why are you transcoding? I watch 4K files on my 4K TV without issues, with Kodi because I don't need Jellyfin for that.
I use Jellyfin to stream when I'm outside my home, and transcoding 4K is what takes a lot of resources.