Get an old bike that's in good mechanical condition but looks shitty.

Alternatively, figure out how to take the bike with you on the bus. My transit system's buses have bike racks on the front, but if yours doesn't, get a folding bike (e.g. a Brompton).