I wouldn't say I really care if the "community" is big or small (it's also a bit unclear what you mean exactly, do you just mean user adoption?)... but I care about Linux (and in general, open source alternatives) being real options when it comes to hardware support, compatibility with services I might want to use, etc.
I don't think you can have proper "progress" in those areas without having Linux be a recognized mainstream system. Like say.. banks are unlikely to make an authenticator app for non-Android Linux phones if non-Android Linux phones are not mainstream, for example.