I think that consciousness is the way information feels when being processed in certain complex ways. - Max Tegmark

After DeepMind’s breakthrough, there’s no reason why a robot can’t ultimately use some variant of deep reinforcement learning to teach itself to walk without help from human programmers: all that’s needed is a system that gives it points whenever it makes progress. Robots in the real world similarly have the potential to learn to swim, fly, play ping-pong, fight and perform a nearly endless list of other motor tasks without help from human programmers. To speed things up and reduce the risk of getting stuck or damaging themselves during the learning process, they would probably do the first stages of their learning in virtual reality.

Accidental nuclear war between two superpowers may or may not happen in my lifetime, but if it does, it will obviously change everything. The climate change we're currently worrying about pales in comparison with nuclear winter, where a global dust cloud blocks sunlight for years, much like when an asteroid or supervolcano caused a mass extinction in the past. The 2008 economic turmoil was of course nothing compared to the resulting global crop failures, infrastructure collapse and mass starvation, with survivors succumbing to hungry armed gangs systematically pillaging from house to house. Do I expect to see this in my lifetime? I'd give it about 30%, putting it roughly on par with my getting cancer. Yet we devote way less attention and resources to reducing the risk of nuclear disaster than we do for cancer. And whereas humanity as a whole survives even if 30% get cancer, it's less obvious to what extent our civilization would survive a nuclear Armageddon. There are concrete and straightforward steps that can be taken to slash this risk, as spelled out in numerous reports by scientific organizations, but these never become major election issues and tend to get largely ignored.

This ability of Life 2.0 to design its software enables it to be much smarter than Life 1.0