One interesting feature in this paper is that the programmers who used LLMs thought they were faster, they estimated it was saving about 20% of the time it would have taken without LLMs. I think that's a clear sign that you shouldn't trust your gut about how much time LLMs save you, you should definitely try to measure it.