Sounds like you need a dose of good old CYA: summarize everything relevant that he tells you in an email and add something like „let me know if I misunderstood“. Later, when he doubts he ever instructed you to do something, you can dig out the corresponding email.