you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 2 weeks ago (2 children)

Good question! Unfortunately, I haven't found a good source myself. I've been trying to piece it together based on my theoretical/mathematical neuroscience background and self-study about transformer architectures. The problem is the point neurons in transformers don't map to neurons in cortex. You have to instead look at the bigger functions that are being computed by each system.

The best single source to learn more about theoretical neuroscience is Neuronal Dynamics: From Single Neurons to Networks and Models of cognition. But its super math heavy. If you want to easier to digest videos I recommend Artem Kirsanov on youtube. For transformer architecture 3 Blue 1 Brown has a great series of videos about it on YouTube as well.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 2 weeks ago (1 child)

    I’m not afraid of a little math so I’ll give the book a try, thanks for the recommendation!

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 1 week ago

    Just remembered another great book kind of bridging both topics that's a great introduction to the field. Its called Models of the Mind by Grace Lindsay. It follows the history of computational/theoretical neuroscience and how we got to our modern understanding. Its written for a more general audience than Neuronal Dynamics and gives a great overview of the field.

  • source
  • parent