Very much smart people (piefedimages.s3.eu-central-003.backblazeb2.com)
 
Post:"this is who you're arguing with online" Picture of a neural network. Reply:"there's too many people with "AI/ML" in their bio asking what this image is"
you are viewing a single comment's thread
view the rest of the comments
[–] 10 points 1 year ago (3 children)

Hell, I’ve been training models and using ML directly for a decade and I barely know what’s going on in there.

Outside of low dimensional toy models, I don’t think we’re capable of understanding what’s happening. Even in academia, work on the ability to reliably understand trained networks is still in its infancy.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 1 year ago

    I remember studying "Probably Approximately Correct" learning and such, and it was a pretty cool way of building axioms, theorems, and proofs to bound and reason about ML models. To my knowledge, there isn't really anything like it for large networks; maybe someday.

  • source
  • parent
  • [–] 1 point 1 year ago (1 child)

    Which is funny considering that Neural Networks have been a thing since the 90s.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 1 year ago

    ... 1957

    Perceptrons. The math dates back to the 40s, but '57 marks the first artificial neural network.

    Also 35 years is infancy in science, or at least teenage, as we see from deep learning's growing pains right now. Visualizations of neural network responses and reverse engineering neural networks to understand how they tick predate 2010 at least. Deep Dream was actually built off an idea of network inversion visualizations, and that's ten years old now.

  • source
  • parent