Fullwood James
School of Mathematical Sciences, Shanghai Jiao Tong University, Shanghai 200240, China.
Entropy (Basel). 2023 Apr 15;25(4):663. doi: 10.3390/e25040663.
We characterize mutual information as the unique map on ordered pairs of discrete random variables satisfying a set of axioms similar to those of Faddeev's characterization of the Shannon entropy. There is a new axiom in our characterization, however, which has no analog for Shannon entropy, based on the notion of a , which may be thought of as a composition of communication channels for which conditional entropy acts functorially. Our proofs are coordinate-free in the sense that no logarithms appear in our calculations.
我们将互信息刻画为离散随机变量有序对的唯一映射,它满足一组类似于法捷耶夫对香农熵刻画的公理。然而,在我们的刻画中有一个新公理,基于 的概念,它对于香农熵没有类似物, 可以被认为是条件熵起函子作用的通信信道的一种复合。我们的证明在无坐标意义上是无坐标的,即在我们的计算中不出现对数。