an ultraintelligent machine could design even better machines; there would then unquestionably be an ‘intelligence explosion,’ and the intelligence o… - Max Tegmark

This ability of Life 2.0 to design its software enables it to be much smarter than Life 1.0

Accidental nuclear war between two superpowers may or may not happen in my lifetime, but if it does, it will obviously change everything. The climate change we're currently worrying about pales in comparison with nuclear winter, where a global dust cloud blocks sunlight for years, much like when an asteroid or supervolcano caused a mass extinction in the past. The 2008 economic turmoil was of course nothing compared to the resulting global crop failures, infrastructure collapse and mass starvation, with survivors succumbing to hungry armed gangs systematically pillaging from house to house. Do I expect to see this in my lifetime? I'd give it about 30%, putting it roughly on par with my getting cancer. Yet we devote way less attention and resources to reducing the risk of nuclear disaster than we do for cancer. And whereas humanity as a whole survives even if 30% get cancer, it's less obvious to what extent our civilization would survive a nuclear Armageddon. There are concrete and straightforward steps that can be taken to slash this risk, as spelled out in numerous reports by scientific organizations, but these never become major election issues and tend to get largely ignored.

computer scientists call validation: whereas verification asks “Did I build the system right?,” validation asks “Did I build the right system?