6'4" here.
I wouldn't say I'd want to be shorter, but I have definitely experienced a lot of what you describe.
In addition to being intimidating because I'm big, I also have real bad resting murder face. It used to bother me, but my wife is 5'1" (on a good day), and we've used it to her advantage.
She's often dismissed or not taken seriously. When she is being disrespected or expects to be, she brings me along. Everyone always treats her with respect when I'm standing behind her.
I don't like taking the train because my knees are pushed up against the seat in front of me. I'm also uncomfortable in most cars. I'm long in the torso, so even in an SUV I have to lean the seat way back to fit in. I currently drive a 2nd generation Honda Ridgeline, and it's the first time in decades where I have space above my head.
Clothing is difficult. I buy my clothing online because I can never find more than one or two options that fit in a store. I used to go to a outlet store because they had such a massive inventory, I could actually find things in my size. My shirts tend to be like tents because I usually can't find the extra tall sizes, so I end up getting a regular 3x so the shirt reaches down to my waist.
There's another downside to being tall that you didn't mention. Years ago my son (taller than me) noticed that you don't see many tall, elderly people. I had to break the news to him that, statistically speaking, being taller means dying earlier.
Bigger people have more cells in their body. More cells means more chances for cancer. More cancer means shorter life.
So, if you're miserable being tall, take some consolation from the knowledge that it won't last long.