Further, OpenSSH using musl (pronounced muscle) must not use PAM (pluggable authentication modules),

which Alpine doesn't ship by default. Maybe one or the other remote administration suite depends on it, but those are often suspectible to exploits anyway. But you don't expose either to WAN, right?