Comment by briian

Comment by briian 2 days ago

9 replies

One thought I have from this is,

Are OpenAI funding research into neuroscience?

Artificial Neural Networks were somewhat based off of the human brain.

Some of the frameworks that made LLMs what they are today are too based of our understanding of how the brain works.

Obviously LLMs are somewhat black boxes at the moment.

But if we understood the brain better, would we not be able to imitate consciousness better? If there is a limit to throwing compute at LLMs, then understanding the brain could be the key to unlocking even more intelligence from them.

paulddraper 2 days ago

As far as anyone can tell, there is virtually no similarity between brains and LLMs.

Neural nets were named such because they have connected nodes. And that’s it.

  • permo-w 2 days ago

    this so obviously not true that I can't fathom why you would say it

    • bravesoul2 a day ago

      Matrix multiplication and some non linearities (gates) to ensure it ain't just a linear regression. Not like my brain.

      • permo-w 19 hours ago

        and yet here you are producing a string of text probabilistically related to the text I inputted into your brain

    • paulddraper 2 days ago

      “Artificial Neural Networks were somewhat based off of the human brain.

      “Some of the frameworks that made LLMs what they are today are too based of our understanding of how the brain works.”

      • permo-w 2 days ago

        these quotes do not change lack of truth in the original statement

        there are far more similarities between a brain and an LLM than containing nodes

        • paulddraper 2 days ago

          I misread, I thought you said "so obviously true."

          I won't offer a rebuttal to that statement.