General (non-narrow) intelligence of the sort we all display daily is not an algorithm running in our heads, but calls on the entire cultural, histor… - Erik J. Larson

Kurzweilians and Russellians alike promulgate a technocentric view of the world that both simplifies views of people — in particular, with deflationary views of intelligence as computation — and expands views of technology, by promoting futurism about AI as science and not myth.
Focusing on bat suits instead of Bruce Wayne has gotten us into a lot of trouble. We see unlimited possibilities for machines, but a restricted horizon for ourselves. In fact, the future intelligence of machines is a scientific question, not a mythological one. If AI keeps following the same pattern of overperforming in the fake world of games or ad placement, we might end up, at the limit, with fantastically intrusive and dangerous idiot savants.

This cuts the myth at an awkward angle: it is because the [artificial intelligence] systems are idiots, but still find their way into business, consumer, and government application, that human-value questions are now infecting what were once purely scientific values.

First, intelligence is situational — there is no such thing as general intelligence. Your brain is one piece in a broader system which includes your body, your environment, other humans, and culture as a whole. Second, it is contextual — far from existing in a vacuum, any individual intelligence will always be both defined and limited by its environment. (And currently, the environment, not the brain, is acting as the bottleneck to intelligence.) Third, human intelligence is largely externalized, contained not in your brain but in your civilization. Think of individuals as tools, whose brains are modules in a cognitive system much larger than themselves — a system that is self-improving and has been for a long time.