Plan B to Prepare for Artificial Superintelligence

What We Do if Alignment Fails

Artificial Superintelligence is likely to be approaching. There are no promising ideas for ensuring its alignment. It’s possible of course that ASI will not be created in the foreseeable future, just as it’s possible that one of the existing alignment ideas might work. However, the expected timelines of AGI are shrinking, and the probability of alignment success is low enough that it’s time to consider strategies of desperation — what to do if ASI emerges, and we can’t control it. A Plan B for…