you are viewing a single comment's thread
view the rest of the comments
[–] 25 points 1 year ago (13 children)

I tell people who work under me to scrutinize it like it's a Google search result chosen for them using the old I'm Feeling Lucky button.

Just yesterday I was having trouble enrolling a new agent in my elk stack. It wanted me to obliterate a config and replace it with something else. Literally would have broken everything.

It's like copying and pasting stack overflow into prod.

AI is useful. It is not trustworthy.

  • source
  • hideshow 13 child comments
  • [–] 12 points 1 year ago (4 children)

    Sounds more actively harmful than useful to me.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 5 points 1 year ago (2 children)

    When it works it can save time automating annoying tasks.

    The problem is “when it works”. It’s like having to do code reviews mid work every time the dumb machine does something.

  • source
  • parent
  • hideshow 2 child comments
  • [–] [S] 3 points 1 year ago (2 children)

    Yeah, you just have to practice a little skepticism.

    I don't know what its actual error rate is, but if we say hypothetically that it gives bad info 5% the time: you wouldn't want a calculator or an encyclopedia that was wrong that often, but you would really value an advisor that pointed you toward the right info 95% of the time.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 7 points 1 year ago*

    5% error rate is being very generous, and unlike a human, it won’t ever say “I’m not sure if that’s correct.”

    Considering the insane amount of resources AI takes, and the fact it’s probably ruining the research and writing skills of an entire generation, I’m not so sure it’s a good thing, not to mention the implications it also has for mass surveillance and deepfakes.

  • source
  • parent
  • [–] 1 point 1 year ago

    Just the other day I was researching potential solutions to a programming issue I had at work. Basically, I asked AI "Is there an API call available to tweak this config" It responded "Yes, you can do that with the tweak-that-config command"

    I went to check the documentation for the "tweak-that-config" command. It just plain didn't exist, and never had. Turns out there was no API call to tweak the config I wanted, and attempting to use AI as a search engine is, in fact, a waste of time.

  • source
  • parent
  • [–] 1 point 1 year ago

    I think of it like talking to some random know-it-all that saddles up next to you at the bar. Yeah, they may have interesting stories but are you really going to take legal advice from them?

  • source
  • parent