Claude Shannon, the founder of information theory, invented a way to measure 'the amount of information' in a message without defining the word 'info… - Hans Christian von Baeyer

As every bookie knows instinctively, a number such as reliability - a qualitative rather than a quantitative measure - is needed to make the valuation of information practically useful.

If the intensity of the material world is plotted along the horizontal axis, and the response of the human mind is on the vertical, the relation between the two is represented by the logarithmic curve. Could this rule provide a clue to the relationship between the objective measure of information, and our subjective perception of it?

Entropy is not about speeds or positions of particles, the way temperature and pressure and volume are, but about our lack of information.