I agree that would be a much smaller proportion of the re-enactors, yes.

In fact I've been mighty impressed over the years seeing situations in which people intentionally live in very limited conditions, doing their best to abide by the conditions of the historical era in question. So I'd be surprised if someone wasn't trying to do this from the perspective of castles, even if just for le weekend or whatever.

I also understand that castle-life could be... not exactly the 'glamour life,' even if you were a noble or liege. For example cold, damp, poorly lit, with poor hygiene, pests and S.A.D. conditions, perhaps. Many of the servants, staff and whoever else probably didn't have much agency to escape that drudge.