I feel like the important part is just to be able to remember sounds well enough to do that. You just haven't memorized them directly. The notes and even the entire scale are ultimately arbitrary, so matching the remembered pitches to notes is just some additional memorization.