Comment by permo-w
this so obviously not true that I can't fathom why you would say it
this so obviously not true that I can't fathom why you would say it
Orthorogonal:
1. Is the brain deterministic and lacking free will.
2. Does a brain use matmul or something else.
1. almost certainly yes
2. completely irrelevant. GP said that LLMs share nothing in common with brains. responding probabilistically to text is something in common with brains. even if we don't want to get into the nuts and bolts of how ANNs work, the actual input/output structure is common with LLMs
“Artificial Neural Networks were somewhat based off of the human brain.
“Some of the frameworks that made LLMs what they are today are too based of our understanding of how the brain works.”
I misread, I thought you said "so obviously true."
I won't offer a rebuttal to that statement.
Matrix multiplication and some non linearities (gates) to ensure it ain't just a linear regression. Not like my brain.