The more disordered something is – the higher its entropy – the more information is needed to describe it. As the physicist and broadcaster Jim Al-Khalili puts it, a well-shuffled pack of cards has higher entropy than an unshuffled one and therefore its description requires far more explanation, or information.
