Comment by xpe

Comment by xpe 3 days ago

4 replies

> Until the thing can learn on its own and advance its capabilities to the same degree that a junior developer can, it is not intelligent enough to do that work.

This confuses intelligence with memory (or state) which tends to enable continuous learning.

xpe 20 hours ago

Update: it might have been clearer and more helpful if I wrote this instead…

This idea of intelligence stated above seems to combine computation, memory, and self-improvement. These three concepts (as I understand them) are both different and logically decoupled.

For example, in the context of general agents, computational ability can change without affecting memory capability. Also, high computational ability does not necessarily confer self-improvement abilities. Having more memory does not necessarily benefit self-improvement.

In the case of biology, it is possible that self improvement demands energy savings and therefore sensory processing degradation. This conceptually relates to a low power CPU mode or a gasoline engine that can turn off some cylinders.

jeremyjh 3 days ago

No confusion here.

This is just semantics, but you brought it up. The very first definition of intelligence provided by Webster:

1.a. the ability to learn or understand or to deal with new or trying situations : reason also : the skilled use of reason

https://www.merriam-webster.com/dictionary/intelligence

  • xpe 20 hours ago

    A time traveler from the future has recommended we both read or reread “Disputing Definitions” by Yudkowsky (2008).

    Some favorite quotes of mine from it:

    > Dictionary editors are historians of usage, not legislators of language. Dictionary editors find words in current usage, then write down the words next to (a small part of) what people seem to mean by them.

    > Arguing about definitions is a garden path; people wouldn't go down the path if they saw at the outset where it led.

    >> Eliezer: "Personally I'd say that if the issue arises, both sides should switch to describing the event in unambiguous lower-level constituents, like acoustic vibrations or auditory experiences. Or each side could designate a new word, like 'alberzle' and 'bargulum', to use for what they respectively used to call 'sound'; and then both sides could use the new words consistently. That way neither side has to back down or lose face, but they can still communicate. And of course you should try to keep track, at all times, of some testable proposition that the argument is actually about. Does that sound right to you?"

  • xpe 21 hours ago

    Ok, let’s work with that definition for this subthread. Even so, one can satisfy that definition without having the ability to:

    > “advance its capabilities”

    (your phrase)

    An example would be a person with damaged short-term memory. And (pretty sure) an AI system without history and that cannot modify itself.