Comment by bigmadshoe a day ago
We don't have a complete enough theory of neuroscience to conclude that much of human "reasoning" is not "algorithmic pattern matching mixed with statistical likelihoods of success".
Regardless of how it models intelligence, why is it not AI? Do you mean it is not AGI? A system that can take a piece of text as input and output a reasonable response is obviously exhibiting some form of intelligence, regardless of the internal workings.
It’s easy to attribute intelligence these systems. They have a flexibility and unpredictability that hasn't typically been associated with computers, but it all rests on (relatively) simple mathematics. We know this is true. We also know that means it has limitations and can't actually reason information. The corpus of work is huge - and that allows the results to be pretty striking - but once you do hit a corner with any of this tech, it can't simply reason about the unknown. If its not in the training data - or the training data is outdated - it will not be able to course correct at all. Thus, it lacks reasoning capability, which is a fundamental attribute of any form of intelligence.
> it all rests on (relatively) simple mathematics. We know this is true. We also know that means it has limitations and can't actually reason information.
What do you imagine is happening inside biological minds that enables reasoning that is something different to, a lot of, "simple mathematics"?
You state that because it is built up of simple mathematics it cannot be reasoning, but this does not follow at all, unless you can posit some other mechanism that gives rise to intelligence and reasoning that is not able to be modelled mathematically.
Because whats inside our minds is more than mathematics, or we would be able to explain human behavior with the purity of mathematics, and so far, we can't.
We can prove the behavior of LLMs with mathematics, because its foundations are constructed. That also means it has the same limits of anything else we use applied mathematics for. Is the broad market analysis that HFT firms use software for to make automated trades also intelligent?
Your first sentence is a non-sequitur. The fact that we can't explain human behavior does not mean that our minds are more than mathematics.
While absence of proof is not proof of absence, as far as I know, we have not found a physics process in the brain that is not computable in principle.
Note that what you claim is not a fact, but a (highly controversial) philosophical position. Some notable such "non-computationalist" views are e.g. Searle's biological naturalism, Penrose's non-algorithmic view (already discussed, and rejected, by Turing) and of course many theological dualist views.
Your reasoning is invalid.
For your claim to be true, it would need to be provably impossible to explain human behavior with mathematics.
For that to be true, humans would need to be able to compute functions that are computable but outside the Turing computable, outside the set of lambda functions, and outside the set of generally recursive functions (the tree are computationally equivalent).
We know of no such function. We don't know how to construct such a function. We don't know how it would be possible to model such a function with known physics.
It's an extraordinary claim, with no evidence behind it.
The only evidence needed would be a single example of a function we can compute outside the Turing computable set, which would seem to make the lack of such evidence make it rather improbably.
It could still be true, just like there could truly be a teapot in orbit between Earth and Mars. I'm nt holding my breath.
I mean some people have a definition of intelligence that includes a light switch, it has an internal state, it reacts to external stimuli to affect the world around it, so a light switch is more intelligent than a rock.
Leaving aside where you draw the line of what classifies as intelligence or not , you seem to be invoking some kind of non-materialist view of the human mind, that there is some other 'essence' that is not based on fundamental physics and that is what gives rise to intelligence.
If you subscribe to a materialist world view, that the mind is essentially a biological machine then it has to follow that you can replicate it in software and math. To state otherwise is, as I said, invoking a non-materialistic view that there is something non-physical that gives rise to intelligence.
>Because whats inside our minds is more than mathematics,
uh oh, this sounds like magical thinking.
What exactly in our mind is "more" than mathematics exactly.
>or we would be able to explain human behavior with the purity of mathematics
Right, because we understood quantum physics right out of the gate and haven't required a century of desperate study to eek more knowledge from the subject.
Unfortunately it sounds like you are saying "Anything I don't understand is magic", instead of the more rational "I don't understand it, but it seems to be built on repeatable physical systems that are complicated but eventually deciperable"
I always wonder where people get their confidence from. We know so little about our own cognition, what makes us tick, how consciousness emerges, how about thought processes actually fundamentally work. We don't even know why we dream. Yet people proclaim loudly that X clearly isn't intelligent. Ok, but based on what?