LLMs and Humans are Cognitive Cousins – Sean Carroll podcast w/Dr. Chandra Sripada
(preposterousuniverse.com)
Andrew Ng said artificial neural networks are like a “cartoon brain”, which I think is pretty apt. It’s cool that having billions of parameters (cartoon “synapses”) can result in emergent behavior where a machine can “reason”. That was the original idea from as far back as the 1940s, and now we have the compute and have found a transformer architecture that can achieve the original vision. Very cool indeed. What’s not cool is the tech bros turning the tech into a large scale game of blackjack.