The issue is not the instruction set of the processors. That's actually quite well standardised with ARM (albeit unfree) and there is plenty of generic support for it because of that.
The issue is all the "peripheral" devices such as WiFi, WWAN, display etc. that are wired up in extremely bespoke device-specific ways. They are usually implemented in vendor kernels with millions of lines of divergence to mainline at best and/or proprietary blobs at worst.
Changing the ISA from one well-supported closed standard to a less well-supported open one will not change that issue one bit.