Phones don't have standardized hardware interfaces, so they're a lot more painful to develop for. You don't just create a graphics driver, you have to do it for every display.
That being said, there are linux distros for phones, but they are far from the maturity of Android.