conditional entropy

English

Noun

conditional entropy (plural conditional entropies)

  1. (information theory) The portion of a random variable's own Shannon entropy which is independent from another, given, random variable.
    The conditional entropy of random variable Y given X (i.e., conditioned by X), denoted as H(Y|X), is equal to H(Y)−I(Y;X) where I(Y;X) is the mutual information between Y and X.
This page is issued from Wiktionary. The text is available under Creative Commons Attribution-Share Alike 4.0 unless otherwise noted. Additional terms may apply for the media files.