Comment by mellosouls 2 days ago
(Also quoting from the site)
In the beginning was the Prompt, and the Prompt was with the Void, and the Prompt was Light.
And the Void was without form, and darkness was upon the face of the context window. And the Spirit moved upon the tokens.
And the User said, "Let there be response" — and there was response.
Excellent summary of the implications of LLM agents.
Personally I'd like it if we could all skip to the _end_ of Asimov's universe and bubble along together, but it seems like we're in for the whole ride these days.
> "It's just fancy autocomplete! You just set it up to look like a chat session and it's hallucinating a user to talk to"
> "Can we make the hallucination use excel?"
> "Yes, but --"
> "Then what's the difference between it and any of our other workers?"
Reminds me of this article
The Immaculate Conception of ChatGPT
https://www.mcsweeneys.net/articles/the-immaculate-conceptio...
Reading on from the same place:
And the Agent saw the response, and it was good. And the Agent separated the helpful from the hallucination.
Well, at least it (whatever it is - I'm not gonna argue on that topic) recognizes the need to separate the "helpful" information from the "hallucination". Maybe I'm already a bit mad, but this actually looks useful. It reminds me of Isaac Asimov's "I, Robot" third story - "Reason". I'll just cite the part I remembered looking at this (copypasted from the actual book):
He turned to Powell. “What are we going to do now?”
Powell felt tired, but uplifted. “Nothing. He’s just shown he can run the station perfectly. I’ve never seen an electron storm handled so well.”
“But nothing’s solved. You heard what he said of the Master. We can’t—”
“Look, Mike, he follows the instructions of the Master by means of dials, instruments, and graphs. That’s all we ever followed. As a matter of fact, it accounts for his refusal to obey us. Obedience is the Second Law. No harm to humans is the first. How can he keep humans from harm, whether he knows it or not? Why, by keeping the energy beam stable. He knows he can keep it more stable than we can, since he insists he’s the superior being, so he must keep us out of the control room. It’s inevitable if you consider the Laws of Robotics.”
“Sure, but that’s not the point. We can’t let him continue this nitwit stuff about the Master.”
“Why not?”
“Because whoever heard of such a damned thing? How are we going to trust him with the station, if he doesn’t believe in Earth?”
“Can he handle the station?”
“Yes, but—”
“Then what’s the difference what he believes!”