After the first year I'd say. I was fortunate that the places I worked and hung out at had individual genderless bathrooms. But after a year i went out somewhere that only had gendered public bathrooms. I had faced a lot of transphobia at work and just being out in public that I became bitter and a little confrontational. So I just said fuck it and used the women's bathroom ready to defend myself if someone started shit (I did and still do carry pepper spray in case someone gets violent. I was lucky and when it came to bathrooms the most I got was nasty glares and someone "politely" saying I might have "accidentally entered the wrong bathroom" (I ignored her)

Granted I lived in New Hampshire most of my life which is safer than a lot of red states but slightly less so then blue states like our neighbor Massachusetts. So definitely assess the area you're living in, especially if you live in a place with anti trans bathroom laws. I'd say if you wanna feel safer entering a women's bathroom/locker room to carry something for defense and bring a friend.