The site publishes the paper and the peer reviews (few journals publish peer reviews). Readers can then decide if the science is valid, or not.

…So like Wikipedia for papers? With the “peer review” being the discussion section?

That sounds like a great project for Wikimedia TBH. That + Arixv's nice frontend is literally the stack to do it. And they have the name recognition to draw people in.