Honestly, I think you do have dysphoria about it. The test for genital dysphoria is not, "am I going to end my life if I don't get surgery?" The test is, "if I could press a magic button and instantly and painlessly have a set of the opposite sex parts, would I do so?"
Whether surgery is actually worth the pain, expense, risk, and compromises? That's a whole other question. But I find the majority of trans people who say they don't have genital dysphoria absolutely do. But a lot of folks make the same mistake people do about gender dysphoria in general. They'll act like they don't have it as long as they're not literally on a bridge about to jump off from the pain.
Don't write it off. You can find a way to make it happen. But make no mistake. The phrases, "I wish I had a pussy," and, "I don't experience dysphoria from having one (a penis)," are mutually contradictory.