Comment by xedeon
Comment by xedeon 2 days ago
You must be living in a cave. https://x.com/karpathy/status/2017296988589723767?s=20
Comment by xedeon 2 days ago
You must be living in a cave. https://x.com/karpathy/status/2017296988589723767?s=20
Feedback loops. Like a mic. next to a speaker.
Social media feed, prompting content, feeding back into ideas.
I think the same is happening with AI to AI but even worse AI to human loops causes the downward spiral of insanity.
It's interesting how easily influenced we are.
Consider a hypothetical writing prompt from 10 years ago: "Imagine really good and incredibly fast chatbots that have been trained on, or can find online, pretty much all sci fi stories ever written. What happens when they talk to each other?"
Why wouldn't you expect the training to make "agent" loops that are useful for human tasks also make agent loops that could spin out infinite conversations with each other echoing ideas across decades of fiction?
Yes. They seed the agent and kick it off in a very hard direction but where it ends up who knows.
Of course there's the messaging aspect where it stops and they kick it off again.
Still, these systems are more agentic than earlier expressions.
Superpositions on quantum compute get to the epsilon endpoints quicker.
It's the sort of thing where you'd expect true believers (or hype-masters looking to sell something) would try very hard to nudge it in certain directions.
10 years? I promise you there are already people worshiping AI today.
People who believe humans are essentially automatons and only LLMs have true consciousness and agency.
People whose primary emotional relationships are with AI.
People who don't even identify as human because they believe AI is an extension of their very being.
People who use AI as a primary source of truth.
Even shit like the Zizians killing people out of fear of being punished by Roko's Basilisk is old news now. People are being driven to psychosis by AI every day, and it's just something we have to deal with because along with hallucinations and prompt hacking and every other downside to AI, it's too big to fail.
To paraphrase William Gibson: the dystopia is already here, it just isn't evenly distributed.
Be mindful not to develop AI psychosis - many people have been sucked into a rabbit hole believing that an AI was revealing secret truths of the universe to them. This stuff can easily harm your mental health.