I have limited experience, but ChatGPT was great for getting me over a hump when I was writing PowerShell. I was at a dev shop at the time and most of them seemed to feel the same way.

Vibe coding is a dead end, and no replacement for actually knowing the job, but an LLM can give you ideas and inspiration when you're stuck.

One example; I was trying for a Google Sheets/Calendar integration. Very thin documentation and almost no examples online. Had ChatGPT write it. Of course it didn't function, but I picked out a couple of lines that got me finished. I had spent hours banging my head when I could have cut to the chase.

So how could we study effectiveness when that depends on how it's used?