i used to have an mp3-player with only an audio jack, and a USB-to-TRRS cable for charging and data transfer.

i think it had 64MB of storage?

point is, it's been a thing

Edit:

also my keyboard! the two halves are connected together via audio jack.