Two-dimensional dispersion entropy: An information-theoretic method for irregularity analysis of images

Abstract Two-dimensional sample entropy (SampEn2D) is a recently developed method in the field of information theory for evaluating the regularity or predictability of images. SampEn2D, though powerful, has two key limitations: (1) SampEn2D values are undefined for small-sized images; and (2) SampEn2D is computationally expensive for several real-world applications. To overcome these drawbacks, we introduce the two-dimensional dispersion entropy (DispEn2D) measure. To evaluate the ability of DispEn2D, in comparison with SampEn2D, we use various synthetic and real datasets. The results demonstrate that DispEn2D distinguishes different amounts of white Gaussian and salt and pepper noise. The periodic images, compared with their corresponding synthesized ones, have lower DispEn2D values. The results for Kylberg texture dataset show the ability of DispEn2D to differentiate various textures. Although the results based on DispEn2D and SampEn2D for both the synthetic and real datasets are consistent in that they lead to similar findings about the irregularity of images, DispEn2D has three main advantages over SampEn2D: (1) DispEn2D, unlike SampEn2D, does not lead to undefined values; (2) DispEn2D is noticeably quicker; and (3) The coefficient of variations and Mann–Whitney U test-based p-values for DispEn2D are considerably smaller, showing the more stability of the DispEn2D results. Overall, thanks to its successful performance and low computational time, DispEn2D opens up a new way to analyze the uncertainty of images.

[1]  Mirjana M. Platiša,et al.  Dependence of heart rate variability on heart period in disease and aging , 2006, Physiological measurement.

[2]  F. Chapeau-Blondeau,et al.  Multifractality, sample entropy, and wavelet analyses for age-related changes in the peripheral cardiovascular system: preliminary results. , 2008, Medical physics.

[3]  B. Pompe,et al.  Permutation entropy: a natural complexity measure for time series. , 2002, Physical review letters.

[4]  Shuen-De Wu,et al.  Refined scale-dependent permutation entropy to analyze systems complexity , 2016 .

[5]  John E. Hummel Object Recognition , 2014, Computer Vision, A Reference Guide.

[6]  Hamed Azami,et al.  Dispersion Entropy: A Measure for Time-Series Analysis , 2016, IEEE Signal Processing Letters.

[7]  Wlodzislaw Duch,et al.  Uncertainty of data, fuzzy membership functions, and multilayer perceptrons , 2005, IEEE Transactions on Neural Networks.

[8]  Hamed Azami,et al.  Amplitude- and Fluctuation-Based Dispersion Entropy , 2018, Entropy.

[9]  Deo Prakash Vidyarthi,et al.  Admission control in cloud computing using game theory , 2015, The Journal of Supercomputing.

[10]  T. Marchant,et al.  The approximate entropy concept extended to three dimensions for calibrated, single parameter structural complexity interrogation of volumetric images. , 2017, Physics in medicine and biology.

[11]  Moses O. Sokunbi,et al.  Sample entropy reveals high discriminative power between young and elderly adults in short fMRI data sets , 2014, Front. Neuroinform..

[12]  Haroldo V. Ribeiro,et al.  Discriminating image textures with the multiscale two-dimensional complexity-entropy causality plane , 2016, ArXiv.

[13]  S M Pincus,et al.  Approximate entropy as a measure of system complexity. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[14]  J. Richman,et al.  Physiological time-series analysis using approximate entropy and sample entropy. , 2000, American journal of physiology. Heart and circulatory physiology.

[15]  Saeed Mozaffari,et al.  Scale- and rotation-invariant texture description with improved local binary pattern features , 2015, Signal Process..

[16]  Massimiliano Zanin,et al.  Permutation Entropy and Its Main Biomedical and Econophysics Applications: A Review , 2012, Entropy.

[17]  Hamed Azami,et al.  Amplitude-aware permutation entropy: Illustration in spike detection and signal segmentation , 2016, Comput. Methods Programs Biomed..

[18]  E. K. Lenzi,et al.  Complexity-Entropy Causality Plane as a Complexity Measure for Two-Dimensional Patterns , 2012, PloS one.

[19]  George F. Reed,et al.  Use of Coefficient of Variation in Assessing Variability of Quantitative Assays , 2002, Clinical and Vaccine Immunology.

[20]  Matjaž Perc,et al.  History of art paintings through the lens of entropy and complexity , 2018, Proceedings of the National Academy of Sciences.

[21]  David Cuesta-Frau,et al.  Automatic segmentation of long-term ECG signals corrupted with broadband noise based on sample entropy , 2010, Comput. Methods Programs Biomed..

[22]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[23]  L. E. V. Silva,et al.  Two-dimensional sample entropy: assessing image texture through irregularity , 2016 .

[24]  Claude E. Shannon,et al.  The mathematical theory of communication , 1950 .

[25]  Odemir Martinez Bruno,et al.  Fractal Descriptors Based on Fourier Spectrum Applied to Texture Analysis , 2012, ArXiv.

[26]  M. Pfeffer,et al.  Myocardial Infarct Size and Ventricular Function in Rats , 1979, Circulation research.

[27]  Hamed Azami,et al.  Bidimensional Distribution Entropy to Analyze the Irregularity of Small-Sized Textures , 2017, IEEE Signal Processing Letters.

[28]  Joaquim Cezar Felipe,et al.  Two-dimensional multiscale entropy analysis: Applications to image texture evaluation , 2018, Signal Process..

[29]  Kai-Sheng Hsieh,et al.  A robust algorithm for the fractal dimension of images and its applications to the classification of natural images and ultrasonic liver images , 2010, Signal Process..

[30]  David J. C. MacKay,et al.  Variational Gaussian process classifiers , 2000, IEEE Trans. Neural Networks Learn. Syst..

[31]  D. Abásolo,et al.  Entropy analysis of the EEG background activity in Alzheimer's disease patients , 2006, Physiological measurement.

[32]  Dingchang Zheng,et al.  Assessing the complexity of short-term heartbeat interval series by distribution entropy , 2014, Medical & Biological Engineering & Computing.

[33]  A L Goldberger,et al.  Physiological time-series analysis: what does regularity quantify? , 1994, The American journal of physiology.

[34]  Christopher J. Moore,et al.  Quantifying structure regularity in fluorescence microscopy cell images using a novel multi-dimensional approximate entropy metric , 2011, 2011 18th IEEE International Conference on Image Processing.

[35]  R. Rosenthal Parametric measures of effect size. , 1994 .