this mysterious irreversibility is of precisely the same character as the mysterious irreversibility in thermodynamics, as codified in the Second Law: It’s a consequence of making approximations and throwing away information,
The loss of information is one meaning of "entropy."