📇 Index
Highlights
Highlight ( đź”—)
Claude Shannon, the father of information theory, studied communication and needed some measure for the amount of information that is exchanged when two entities communicate. The measure he came up with is called surprisal (also known as information content, Shannon information, or self-information). Shannon realized that how much information is contained in a message is determined by how surprising the message is.