The greatest benefit of the arrival of artificial intelligence is that AIs will help define humanity. We need AIs to tell us who we are. - Kevin Kelly

At the core of the notion of a superhuman intelligence - particularly the view that this intelligence will keep improving itself - is the essential belief that intelligence has an infinite scale. I find no evidence for this. Again, mistaking intelligence as a single dimension helps this belief, but we should understand it as a belief. There is no other physical dimension in the universe that is infinite, as far as science knows so far. Temperature is not infinite - there is finite cold and finite heat. There is finite space and time. Finite speed. Perhaps the mathematical number line is infinite, but all other physical attributes are finite.It stands to reason that reason itself is finite, and not infinite.

All these inventions (and more) permit any literate person to cut and paste ideas, annotate them with her own thoughts, link them to related ideas, search through vast libraries of work, browse subjects quickly, resequence texts, refind material, remix ideas, quote experts, and sample bits of beloved artists. These tools, more than just reading, are the foundations of literacy.

Real dystopias are more like the old Soviet Union rather than Mad Max: They are stiflingly bureaucratic rather than lawless.