To understand... mind, we have to ask how a system capable of constructing has to be built... - Joscha Bach

[W]hile dynamical systems often cannot be effectively computed on a finite state machine (such as a von Neumann computer), they can often be efficiently approximated.

General intelligence is not only the ability to reach a given goal (and usually, there is some very specialized, but non-intelligent way to reach a singular fixed goal, such as winning a game of chess), but includes the setting of novel goals, and most important of all, about exploration. ...[A]n environment with fixed tasks, scaled by an agent with pre-defined goals is not going to make a good benchmark problem for AGI.

[Y]ou don't know this state in which you don't have a self. You can turn off yourself... You can... meditate yourself [into] a state where you are still conscious, where still things are happening, where you know everything that you knew before, but you're no longer identified with changing anything. ...[T]his means that your self ...dissolves. There is no longer this person... you know that this person construct exists in other states and it runs on this brain... but it's not a real thing. It's a construct. It's an idea... and you can change that idea, and if you let go of this idea... If you don't think you are special, you realize it's just one of many people, and it's not your favorite person even... It's just one of many, and it's the one that you are doomed to control... and that is... informing the actions of this organism as a control model. This is all there is, and you are somehow afraid that this control model gets interrupted, or loses the identity of continuity.