Comment by dovin

Comment by dovin 20 hours ago

Dogs offer humans no economic value, but we haven't genocided them. There are a lot of ways that we could offer value that's not necessarily just in the form of watts and minerals. I'm not so sure that our future superintelligent summoned demons will be motivated purely by increasing their own power, resources, and leverage. Then again, maybe they will. Thus far, AI systems that we have created seem surprisingly goal-less. I'm more worried about how humans are going to use them than some sort of breakaway event but yeah, don't love that it's a real possible future.

chipsrafferty 20 hours ago

A world in which most humans fill the role of "pets" of the ultra rich doesn't sound that great.

Reply View 4 replies

dovin 19 hours ago

Humans becoming domesticated by benevolent superintelligences are some of the better futures with superintelligences, in my mind. Iain M Banks' Culture series is the best depiction of this I've come across; they're kind of the utopian rendition of the phrase "all watched over by machines of loving grace". Though it's a little hard to see how we get from here to there.

Reply View | 3 replies
- autumnstwilight 18 hours ago
  
  Honestly that part of the article and some other comments have given me the idle speculation, what if that was the solution to the, "Humans no longer feel they can meaningfully contribute to the world," issue?
  Like we can satisfy the hunting and retrieval instincts of dogs by throwing a stick, surely an AI that is 10,000 times more intelligent can devise a stick-retrieval-task for humans in a way that feels like satisfying achievement and meaningful work from our perspective.
  (Leaving aside the question of whether any of that is a likely or desirable outcome.)
  
  Reply View | 2 replies
  
  bamboozled 16 hours ago
  
  What will AI find fulfilling itself? I find that to be quite a deep question.
  I feel the limitations of humans are quite a feature when you think about what the experience of life would be like if you couldn’t forget or experienced things for the first time. If you already knew everything and you could achieve almost anything with zero effort. It actually sounds…insufferable.
  
  Reply View | 1 reply
  
  te0006 15 hours ago
  
  You might find Stanislav Lem's Golem XIV worth a read, in which a what we now call an AGI shares, amongst other things, its knowledge and speculations about long-term evolution of superintelligences, in a lecture to humans, before entering the next stage itself. https://www.goodreads.com/book/show/10208493 It seems difficult to obtain an English edition these days but there is a reddit thread you might want to look into.
  
  Reply View | 0 replies