So you ask them which way leads to the castle and you don't pick the way they say.

If we're assuming that these things are actually bound by some kind of rule stating they literally cannot lie or literally cannot tell the truth.