Yeah, but depending on where you live you can get some dirt cheap kit on the used market. Depending on who you know you probably could even get a headset gifted. I for sure tried to just give away my Rift S to friends.
Sure, its not the newest shiny thing. But is your PC even powerful enough for these?
I constantly see people in VR communities which are happy because they sniped a headset for 40 - 100 bucks. Which today is like premium controller money or depending on the game not even the price of a premium edition.
Best part is if you invest now for the first time you have tons of games of the last 10 years to play. VR still has a content issue. But not if you get that kind of backlog at once. Well, minus a few great games which were lost in time.