Apologies mean “I made a mistake and I learned from it so it won’t repeat.”

At best it might not make the same mistake again if that memory is in the current context. But more likely: It will not remember.

Although latest Gemini in particular has much more room for "remembering" things, still.

But "I made a mistake"? It is not self-aware in any way shape or form to the degree where "I made a mistake" carries any real meaning.