A Generalization of Majorization that Characterizes Shannon Entropy

We introduce a binary relation on the finite discrete probability distributions, which generalizes notions of majorization that have been studied in quantum information theory. Motivated by questions in thermodynamics, our relation describes the transitions induced by bistochastic maps in the presence of additional auxiliary systems, which may become correlated in the process. We show that this relation is completely characterized by Shannon entropy H, which yields an interpretation of H in resource-theoretic terms, and admits a particularly simple proof of a known characterization of H in terms of natural information-theoretic properties.

[1]  J. Aczel,et al.  WHY THE SHANNON AND HARTLEY ENTROPIES ARE 'NATURAL' , 1974 .

[2]  Michal Horodecki,et al.  The second laws of quantum thermodynamics , 2013, Proceedings of the National Academy of Sciences.

[3]  Robert W. Spekkens,et al.  A mathematical theory of resources , 2014, Inf. Comput..

[4]  M. Montesinos,et al.  A New Proof of a Theorem of J . , 2004 .

[5]  R. Renner,et al.  The minimal work cost of information processing , 2012, Nature Communications.

[6]  TOBIAS FRITZ,et al.  Resource convertibility and ordered commutative monoids , 2015, Mathematical Structures in Computer Science.

[7]  Andreas J. Winter,et al.  The structure of Rényi entropic inequalities , 2012, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[8]  Tom Leinster,et al.  A Characterization of Entropy in Terms of Information Loss , 2011, Entropy.

[9]  A NEW PROOF OF A THEOREM OF P. ERDOS , 1967 .

[10]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[11]  C. G. Chakrabarti,et al.  Shannon entropy: axiomatic characterization and application , 2005, Int. J. Math. Math. Sci..

[12]  Nicole Yunger Halpern,et al.  The resource theory of informational nonequilibrium in thermodynamics , 2013, 1309.6586.

[13]  P. K. Sahoo,et al.  Characterizations of information measures , 1998 .

[14]  M. Horodecki,et al.  Fundamental limitations for quantum and nanoscale thermodynamics , 2011, Nature Communications.

[15]  Milán Mosonyi,et al.  The structure of R\'enyi entropic inequalities , 2012 .

[16]  J. Aczel,et al.  On Measures of Information and Their Characterizations , 2012 .

[17]  J. Oppenheim,et al.  Thermodynamical approach to quantifying quantum correlations. , 2001, Physical review letters.

[18]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[19]  M. Horodecki,et al.  Reversible transformations from pure to mixed states and the unique measure of information , 2002, quant-ph/0212019.

[20]  M. Klimesh.  Inequalities that Collectively Completely Characterize the Catalytic Majorization Relation , 2007, 0709.3680.

[21]  E. Ruch,et al.  The principle of increasing mixing character and some of its consequences , 1976 .

[22]  Matteo Lostaglio,et al.  Stochastic Independence as a Resource in Small-Scale Thermodynamics. , 2014, Physical review letters.

[23]  M. Plenio,et al.  Entanglement-Assisted Local Manipulation of Pure Quantum States , 1999, quant-ph/9905071.

[24]  P. Hayden,et al.  Universal entanglement transformations without communication , 2003 .

[25]  I. Olkin,et al.  Inequalities: Theory of Majorization and Its Applications , 1980 .

[26]  J. P. Burg,et al.  Maximum entropy spectral analysis. , 1967 .

[27]  Peter Harremoës,et al.  Rényi Divergence and Kullback-Leibler Divergence , 2012, IEEE Transactions on Information Theory.

[28]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[29]  Imre Csiszár,et al.  Axiomatic Characterizations of Information Measures , 2008, Entropy.

[30]  S. Turgut.  Necessary and Sufficient Conditions for the Trumping Relation , 2007, 0707.0444.