- https://logics-of-blue.com/information-theory-basic/
- It is easy to understand why it is called log.
-
Let’s define “information quantity” that satisfies the following two requirements.
-
1: When we know that an event has a low probability of occurring (something rare), the information quantity is higher.
-
2: The information quantity increases with addition.