So..
Turns out you can hack your smart TV, and by giving it administrative access (for me it was going into settings, type 1-2-3-4-5, and the select developer mode) and you can get complete control.
I can now stream whatever the hell I like with no interacting with their menus whatsoever. all happens from my server via a html browser and some basic python.