I was just planning to do some sort of write up on this topic, although it will be internal only.

Of the three projects I’m currently on

• existing code base where AI sometimes has good ideas but almost never able to implement them successfully. This is legacy code, all human generated, and is probably too tightly coupled. Test framework is tightly coupled to the environment so ai cannot run it
• new tool implementation to give cheaper and faster context across all repos (Spotify Backstage)
• new code base almost entirely ai generated. Much more loosely coupled. There is no test /mock framework available, so it’s all scripts, which the ai is able to run at will to refine its guesses

There’s definitely distinct conditions where ai can be the right tool and can succeed vs when it can’t. In managements blind rush to vibe code everything, they need to better understand where it works and where it doesn’t

In particular, functionality I’m working on this week

• existing code base ”modify function x to cover scenario y” at best gives a useful strategy
• new code base “implement function x similar to existing code base, but that also covers scenario y” seems to work