PSVR I guess? If so, I feel you. Was super stoked to play Skyrim, and had a similar experience.
Managed to pick up a cheap PC vr headset and Skyrim VR on A Steam sale a bit later and gave it another shot. It's now one of my favourite VR worlds to just hang out in and walk around, chop some wood, etc.
The vanilla console experience was just very Bethesda. I swear they forgot how to make a good game right after Skyrim came out. Everything since then is them stumbling on even the most banal things like a UI that doesn't hate you.