If the message they’re communicating is “no” and not the exact details of why they’re saying no, “I don’t have time” is perfectly adequate. Everyone isn’t entitled to the exact details of why someone is refusing to do something. I’m not telling you if I’m refusing because I have severe diarrhea.