381
AI coders think they’re 20% faster — but they’re actually 19% slower (pivot-to-ai.com)
submitted 1 year ago by to c/techtakes@awful.systems
102 comments fedilink hide all child comments
 

podcast version
video version

you are viewing a single comment's thread
view the rest of the comments
[–] 21 points 1 year ago (2 children)

Paragraph 2:

METR funded 16 experienced open-source developers with “moderate AI experience” to do what they do.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 27 points 1 year ago

    ... and just a few paragraphs further down:

    The number of people tested in the study was n=16. That’s a small number. But it’s a lot better than the usual AI coding promotion, where n=1 ’cos it’s just one guy saying “I’m so much faster now, trust me bro. No, I didn’t measure it.”

    I wouldn't call that "burying information".

  • permalink
  • fedilink
  • source
  • parent