A super basic explanation as I understand it.

With a passkey the server (like Google) only has half of the passkey, you have the other half.

So having the server half be made public is still safe, as it's not useful on its own without the other half that you still have kept private.