Comment by permo-w
and yet here you are producing a string of text probabilistically related to the text I inputted into your brain
and yet here you are producing a string of text probabilistically related to the text I inputted into your brain
1. almost certainly yes
2. completely irrelevant. GP said that LLMs share nothing in common with brains. responding probabilistically to text is something in common with brains. even if we don't want to get into the nuts and bolts of how ANNs work, the actual input/output structure is common with LLMs
But the thing LLMs have in common with brains is they process data and produce data that with additional processing a subset of which can be interpreted as words. It is a pretty loose link.
Like saying an aeroplane is like a squirrel because they both perform aerobic respiration.
Original comment that I agree with, for reference:
> As far as anyone can tell, there is virtually no similarity between brains and LLMs. Neural nets were named such because they have connected nodes. And that’s it.
Orthorogonal:
1. Is the brain deterministic and lacking free will.
2. Does a brain use matmul or something else.