Giving clear instructions about what to do and what not to do, and ensuring those instructions are consistent and not noisy, will forever be a challenge with AI, no matter how good it gets.
We have coworkers, partners, and other people we know and interact with who are sentient. They pass the Turing test, they are “AGI,” and yet: we still have a hard time conveying instructions, ideas, and concepts among each other.
I've been thinking about this lately, and I can very much relate to this statement. Regardless of whether you're working with an agent or a living and breathing colleague, if you don't give them clear requirements and historical context, there is a very good chance they will go off-piste.