Depends on what kind of website we are talking about.
If it's a website whose purpose to display an article or images or similar, I agree with you.
If its main purpose is something that requires interaction by the user (i.e. it's a "web app"), then it's not a reasonable expectation that it should work without JS, and then I agree with the OP.