Have you tried silk dress shirts?
I also hate wearing monkey suits due to sensory issues. But silk feels nice. Not quite as breathable, tho. But the roughness of more common fabrics for those kind of shirts is way more irritating than getting a bit hot inside the clothes.