On modern phones once a call or text conversion begins, it remains. No need to memorize or anything, it's just there and context of past conversations will suffice as the way to know who it is.

(Edit: "Modern phones" good lord I'm a dinosaur. Sorry for the patronizing start.)

I don't think he called me very often. I lived with him. I saw him every day & slept with him every night.