I've been wondering, if you could combine LLMs with a logic programming language like Prolog. The latter is actually able to reason through things, you "just" have to express them in Prolog facts and rules.

Well, from doing a quick online search, I'm most certainly not the first person to think of this, which does not surprise me at all...