Constructing systems that can die a graceful natural death

I would like to argue that the current state of affairs seems to be that companies and institutions are not able or willing to die, they stay with us as unuseful reminders of their glory days. We hold on to their constructed truths and beliefs, like a drunk person to a fence. The pinnacle of…

Value structures and the paperclip maximizer theory

What kind of value structures do we have to develop to protect us from the paperclip maximizer theory? The paperclip maximizer is the canonical thought experiment showing how an artificial general intelligence, even one designed competently and without malice, could ultimately destroy humanity. First described by Bostrom (2003), a paperclip maximizer is an artificial general…