Unfortunately, it won't make much of a dent at all. Amazon's traditional goods business runs on very thin margins, and they can write it off. Their profit center these days is AWS, and there isn't much you or I can do to boycott that.

That said, I have canceled Prime, and I only use Amazon for some hobbyist stuff that's hard to get from literally anywhere else.