361b980e35dbb345d9a6615a62ada1037341f3338c86c4159e61429052421d6fff053e5dbec6a3ae1cea9975c0f9188e782cf4b0d21dd9977298ff0d045b38e1

printouts

{"Answer":["A value handshake is a form of trade between superintelligences, when two AI's with incompatible utility functions meet, instead of going to war, since they have superhuman prediction abilities and likely know the outcome before any attack even happens, they can decide to split the universe into chunks with volumes according to their respective military strength or chance of victory, and if their utility functions are compatible, they might even decide to merge into an AI with an utility function that is the weighted average of the two previous ones.\n\nThis could happen if multiple AI's are active on earth at the same time, and then maybe if at least one of them is aligned with humans, the resulting value handshake could leave humanity in a pretty okay situation. \n\nSee ［https://slatestarcodex.com/2018/04/01/the-hour-i-first-believed/ The Hour I First Believed］ By Scott Alexander for some further thoughts and an introduction to related topics."],"StampedBy":["plex"],"Tags":[{"fulltext":"Superintelligence","fullurl":"https://stampy.ai/wiki/Superintelligence","namespace":0,"exists":"1","displaytitle":"superintelligence"},{"fulltext":"Values","fullurl":"https://stampy.ai/wiki/Values","namespace":0,"exists":"","displaytitle":""}]}

fulltext

Luca's Answer to What is a value handshake?

fullurl

https://stampy.ai/wiki/Luca%27s_Answer_to_What_is_a_value_handshake%3F

namespace

exists

displaytitle

Answer to What is a value handshake?

question

What is a value handshake?

answer

["A value handshake is a form of trade between superintelligences, when two AI's with incompatible utility functions meet, instead of going to war, since they have superhuman prediction abilities and likely know the outcome before any attack even happens, they can decide to split the universe into chunks with volumes according to their respective military strength or chance of victory, and if their utility functions are compatible, they might even decide to merge into an AI with an utility function that is the weighted average of the two previous ones.\n\nThis could happen if multiple AI's are active on earth at the same time, and then maybe if at least one of them is aligned with humans, the resulting value handshake could leave humanity in a pretty okay situation. \n\nSee ［https://slatestarcodex.com/2018/04/01/the-hour-i-first-believed/ The Hour I First Believed］ By Scott Alexander for some further thoughts and an introduction to related topics."]

Question: What is a value handshake?

Answer: A value handshake is a form of trade between superintelligences, when two AI's with incompatible utility functions meet, instead of going to war, since they have superhuman prediction abilities and likely know the outcome before any attack even happens, they can decide to split the universe into chunks with volumes according to their respective military strength or chance of victory, and if their utility functions are compatible, they might even decide to merge into an AI with an utility function that is the weighted average of the two previous ones.

This could happen if multiple AI's are active on earth at the same time, and then maybe if at least one of them is aligned with humans, the resulting value handshake could leave humanity in a pretty okay situation.

See ［https://slatestarcodex.com/2018/04/01/the-hour-i-first-believed/ The Hour I First Believed］ By Scott Alexander for some further thoughts and an introduction to related topics.