imo downvotes can be helpful just as upvotes can be helpful. it all depends on how one lets them shape their behavior.
In this case, for example, I 'care less' about pandering to the desires of others since they downvote anyway; and, in so doing, I am able to generate more pure wisdom less constrained by the views of others. Everything helps if you believe it does :)