Weighted Entropy and its Use in Computer Science and Beyond

The concept of weighted entropy takes into account values of different outcomes, i.e., makes entropy context-dependent, through the weight function. We analyse analogs of the Fisher information inequality and entropy-power inequality for the weighted entropy and discuss connections with weighted Lieb’s splitting inequality. The concepts of rates of the weighted entropy and information are also discussed.

[1]  Geong Sen Poh,et al.  Weighted Entropy-based Measure for Image Segmentation , 2012 .

[2]  Mark Kelbert,et al.  Information Theory and Coding by Example , 2013 .

[3]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[4]  Keith R Shockley,et al.  Using Weighted Entropy to Rank Chemicals in Quantitative High-Throughput Screening Experiments , 2014, Journal of biomolecular screening.

[5]  Constantinos Patsakis,et al.  The Role of Weighted Entropy in Security Quantification , 2013 .

[6]  Sergio Verdú,et al.  A simple proof of the entropy-power inequality , 2006, IEEE Transactions on Information Theory.

[7]  Po-Hsiang Tsui,et al.  Ultrasound Detection of Scatterer Concentration by Weighted Entropy , 2015, Entropy.

[8]  Ram Zamir,et al.  A Proof of the Fisher Information Inequality via a Data Processing Argument , 1998, IEEE Trans. Inf. Theory.

[9]  Jesmin F. Khan,et al.  Weighted entropy for segmentation evaluation , 2014 .

[10]  Yuri M. Suhov,et al.  Weighted Gaussian entropy and determinant inequalities , 2015, Aequationes mathematicae.

[11]  Mark Kelbert,et al.  Continuity of Mutual Entropy in the Limiting Signal-To-Noise Ratio Regimes , 2011 .

[12]  E. Lieb.  Proof of an entropy conjecture of Wehrl , 1978 .

[13]  David N. Nawrocki,et al.  State-value weighted entropy as a measure of investment risk , 1986 .

[14]  G Frizelle,et al.  The measurement of complexity in production and other commercial systems , 2008, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[15]  Y. Suhov,et al.  An entropic measurement of queueing behaviour in a class of manufacturing operations , 2001, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[16]  Yuri M. Suhov,et al.  On principles of large deviation and selected data compression , 2016, ArXiv.

[17]  Yuri M. Suhov,et al.  Basic inequalities for weighted entropies , 2015, ArXiv.

[18]  Yuri M. Suhov,et al.  Weighted information and entropy rates , 2016, ArXiv.

[19]  Lei Yang,et al.  Weighted Information Entropy: A Method for Estimating the Complex Degree of Infrared Images' Backgrounds , 2005, ICIAR.

[20]  Marek Niezgoda,et al.  Inequalities for convex sequences and nondecreasing convex functions , 2017 .

[21]  Mark Kelbert,et al.  Weighted entropy and optimal portfolios for risk-averse Kelly investments , 2017, 1708.03813.