They have context limits, eventually you hit a wall and everything goes poof. If they are now carrying context over when the cap is hits, that is even worse. Your original messages are now mutated by the LLM.