Math is oddly not new to proofs that no human can understand.
Godels incompleteness theorum relies on showing how to construct a proof in the form of preposterous number arrangements. The proofs themselves never got written, and even if they had they would be unintelligible.
In this case, you would demonstrate that the intermediate language has a correspondence to mathematical logic. Similar to how Godel showed how prime numbers can be arranged in such a fashion.
Godels is more useful and interesting though, because in his case the proof-of-proof was more interesting than the actual proof would have been.
Everything else you say is spot on. The knowledge one way or the other isn't actually that important: you can just assume either way if you wanted to explore in that direction. The value is the model that helps people think about the problem in a way that gives insight.
You could literally just say "assume the Riemann hypothesis" and that's just as good.