Joint Entropy - Relations To Other Entropy Measures

Relations To Other Entropy Measures

Joint entropy is used in the definition of conditional entropy

and mutual information

In quantum information theory, the joint entropy is generalized into the joint quantum entropy.

Read more about this topic:  Joint Entropy

Famous quotes containing the words relations to, relations, entropy and/or measures:

    I have no wealthy or popular relations to recommend me.
    Abraham Lincoln (1809–1865)

    Subject the material world to the higher ends by understanding it in all its relations to daily life and action.
    Ellen Henrietta Swallow Richards (1842–1911)

    Just as the constant increase of entropy is the basic law of the universe, so it is the basic law of life to be ever more highly structured and to struggle against entropy.
    Václav Havel (b. 1936)

    Almost everywhere we find . . . the use of various coercive measures, to rid ourselves as quickly as possible of the child within us—i.e., the weak, helpless, dependent creature—in order to become an independent competent adult deserving of respect. When we reencounter this creature in our children, we persecute it with the same measures once used in ourselves.
    Alice Miller (20th century)