Thus, we can think about entropy in two ways

Thus, we can think about entropy in two ways: 1. Entropy is the amount of information that we lack about a question (i.e., our uncertainty about the question). 2. Entropy is the amount of information we obtain when we receive the answer to the question.

— from Takeoff Into Chaos · Practical Uncertainty: Useful Ideas in Decision-Making, Risk, Randomness, and AI by Hossei

In the book

That is the sky as it honestly is — and even the laws of the physical universe lean the same way. Left to itself, everything drifts from order toward disorder; entropy, the physicists call it, a downhill slide that can be described more than one way but always points in the one direction. Pretending otherwise is the single move guaranteed to get you hurt. — Takeoff Into Chaos

Also belongs to

Related