Information theory would never have got off the ground if structured things—configurations—did not exist. - Julian Barbour

[W]hat we call yesterday is self-contained and has its experience of being yesterday, and today has memories of yesterday; and therefor I say that it's later... but each is completely self-contained, and there's no reason why you should put one... here, and another one there...

Ontological primacy should not be given to information but to things, as has always been the standpoint of realists.

If we are to speak about ontology, as opposed to efficient coding in communication channels, the most important symbol in (1) is not <math>p</math> for probability but <math>i</math> for the thing, or configuration, that has the probability <math>p_i</math>.