yes, a gradual taper is a good idea - much better than cold turkey.

Eventually switching to black tea, then green tea, then white tea would also help.

Might also be good to keep a log as a way to ensure you know exactly how many mg of caffeine you're consuming, and to keep yourself honest.