Well if the crowd is booing you, it can mean you're wrong, or that you're bad at the thing youre trying to do, or that you're performing to the wrong audience.

If the crowd is cheering you, they're communicating that they like you or that you did good or that youre simply saying what they want to hear.

In the OPs case, where they're pressing the down arrow way more than the up arrow, it implies that they're in the wrong place as an audience. To extend the shitty analogy I started with, if I only love classic music and soft jazz, I'm not going to have a good time in a mosh pit. I should get out of the mosh pit and find a venue that plays classical music, instead of coming back every night and booing.