Let me share one of the best explanations of digital audio recording ever produced:
D/A and A/D | Digital Show and Tell (Monty Montgomery @ xiph.org)
The premise of the video is to address the common "stairstepping" misconception about digital audio:
Monty at Xiph presents a well thought out and explained, real-time demonstrations of sampling, quantization, bit-depth, and dither on real audio equipment using both modern digital analysis and vintage analog bench equipment.
But Monty goes further into explaining how bit depth affects the stored audio information and playback:
This is a video about the digital vs analog audio quality debate. It explains, with examples, why analog audio within the accepted limits of human hearing (20 Hz to 20 kHz) can be reproduced with perfect fidelity using a 44.1 kHz 16 Bit digital signal.
For street cred, xiph.org is the group that created the Ogg Vorbis and FLAC audio codecs - they know a little about this topic.
I recommend watching the entire demonstration. You will understand your audio files and equipment very differently.