Physical irreversibility manifests itself in the fact that, whenever the system is in a state far removed from equilibrium, it is much more likely to… - William Feller

It should be noted that this duration is considerably longer than we naively expect. If two players with 500 dollars each toss a coin until one is ruined, the average duration of the game is 250,000 trials. If a gambler has only one dollar and his adversary has 1000, the average duration is 1000 trials.

Warning. It is usual to read into the law of large numbers things which it definitely does not imply. If Peter and Paul toss a perfect coin 10,000 times, it is customary to expect that Peter will be in the lead roughly half the time. This is not true. In a large number of different coin-tossing games it is reasonable to expect that any fixed moment heads will be in the lead in roughly half of all cases. But it is quiet likely that the player who ends at the winning side has been in the lead for practically the whole duration of the game. Thus, contrary to widespread belief, the time average for any individual game has nothing to do with the ensemble average at any given moment.

The theory of independent experiments is the analytically simplest and most advanced part of probability theory.