Measuring Complexity and Predictability of Time Series with Flexible Multiscale Entropy for Sensor Networks

Measurement of time series complexity and predictability is sometimes the cornerstone for proposing solutions to topology and congestion control problems in sensor networks. As a method of measuring time series complexity and predictability, multiscale entropy (MSE) has been widely applied in many fields. However, sample entropy, which is the fundamental component of MSE, measures the similarity of two subsequences of a time series with either zero or one, but without in-between values, which causes sudden changes of entropy values even if the time series embraces small changes. This problem becomes especially severe when the length of time series is getting short. For solving such the problem, we propose flexible multiscale entropy (FMSE), which introduces a novel similarity function measuring the similarity of two subsequences with full-range values from zero to one, and thus increases the reliability and stability of measuring time series complexity. The proposed method is evaluated on both synthetic and real time series, including white noise, 1/f noise and real vibration signals. The evaluation results demonstrate that FMSE has a significant improvement in reliability and stability of measuring complexity of time series, especially when the length of time series is short, compared to MSE and composite multiscale entropy (CMSE). The proposed method FMSE is capable of improving the performance of time series analysis based topology and traffic congestion control techniques.

[1]  Pengjian Shang,et al.  Classifying of financial time series based on multiscale entropy and multiscale time irreversibility , 2014 .

[2]  Madalena Costa,et al.  Multiscale entropy analysis of complex physiologic time series. , 2002, Physical review letters.

[3]  Eamonn J. Keogh,et al.  Real-Time Classification of Streaming Sensor Data , 2008, 2008 20th IEEE International Conference on Tools with Artificial Intelligence.

[4]  Xiaoming Chen,et al.  Network Traffic Analysis for Mobile Terminal Based Multi-scale Entropy , 2014, 2014 Asia-Pacific Services Computing Conference.

[5]  Ping Zhou,et al.  Multiscale Entropy Analysis of Different Spontaneous Motor Unit Discharge Patterns , 2013, IEEE Journal of Biomedical and Health Informatics.

[6]  Shuen-De Wu,et al.  Modified multiscale entropy for short-term time series analysis , 2013 .

[7]  Fakhri Karray,et al.  Multisensor data fusion: A review of the state-of-the-art , 2013, Inf. Fusion.

[8]  Xue Wang,et al.  Time Series Forecasting for Energy-efficient Organization of Wireless Sensor Networks , 2007, Sensors.

[9]  Xiaopeng Zhao,et al.  EEG multiscale entropy dynamics in mild cognitive impairment and early Alzheimer's disease , 2014, Proceedings of the 2014 Biomedical Sciences and Engineering Conference.

[10]  Chun-Chieh Wang,et al.  Time Series Analysis Using Composite Multiscale Entropy , 2013, Entropy.

[11]  Madalena Costa,et al.  Multiscale entropy analysis of biological signals. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[12]  Chien-Ming Chou.  Applying Multiscale Entropy to the Complexity Analysis of Rainfall-Runoff Relationships , 2012, Entropy.

[13]  Wang Ming-shi.  Multiscale entropy analysis of EEG signal , 2009 .

[14]  Qin Wei,et al.  Analysis of EEG via Multivariate Empirical Mode Decomposition for Depth of Anesthesia Based on Sample Entropy , 2013, Entropy.

[15]  Yakov A. Pachepsky,et al.  Multiscale Entropy-based Analysis of Soil Transect Data , 2008 .

[16]  Donald F. Towsley,et al.  Detecting anomalies in network traffic using maximum entropy estimation , 2005, IMC '05.

[17]  Grzegorz Litak,et al.  Complex response of a bistable laminated plate: Multiscale entropy analysis , 2014 .

[18]  Daniel A. Keim,et al.  Visual Analysis of Time‐Series Similarities for Anomaly Detection in Sensor Networks , 2014, Comput. Graph. Forum.

[19]  Peter Grassberger,et al.  Information and Complexity Measures in Dynamical Systems , 1991 .

[20]  Qin Wei,et al.  Multivariate Multiscale Entropy Applied to Center of Pressure Signals Analysis: An Effect of Vibration Stimulation of Shoes , 2012, Entropy.

[21]  J. Richman,et al.  Physiological time-series analysis using approximate entropy and sample entropy. , 2000, American journal of physiology. Heart and circulatory physiology.

[22]  Anne Humeau-Heurtier,et al.  The Multiscale Entropy Algorithm and Its Variants: A Review , 2015, Entropy.

[23]  Jun Wang,et al.  Quantifying complexity of financial short-term time series by composite multiscale entropy measure , 2015, Commun. Nonlinear Sci. Numer. Simul..

[24]  Hui Yang,et al.  Sparse particle filtering for modeling space-time dynamics in distributed sensor networks , 2014, 2014 IEEE International Conference on Automation Science and Engineering (CASE).

[25]  Juan Pardo,et al.  Online Learning Algorithm for Time Series Forecasting Suitable for Low Cost Wireless Sensor Networks Nodes , 2015, Sensors.

[26]  E. Scilingo,et al.  Mood states modulate complexity in heartbeat dynamics: A multiscale entropy analysis , 2014 .

[27]  Jun Wang,et al.  Entropy and Recurrence Measures of a Financial Dynamic System by an Interacting Voter System , 2015, Entropy.

[28]  Yong Hu,et al.  Multiscale Entropy Analysis on Human Operating Behavior , 2016, Entropy.

[29]  M. P. Griffin,et al.  Sample entropy analysis of neonatal heart rate variability. , 2002, American journal of physiology. Regulatory, integrative and comparative physiology.

[30]  Qin Wei,et al.  Adaptive Computation of Multiscale Entropy and Its Application in EEG Signals for Monitoring Depth of Anesthesia During Surgery , 2012, Entropy.

[31]  Peng Xu,et al.  A Cross-Layer Congestion Control Algorithm Based on Traffic Prediction in Wireless Sensor Networks , 2013 .

[32]  Edwin Lughofer,et al.  Fault detection in multi-sensor networks based on multivariate time-series models and orthogonal transformations , 2014, Inf. Fusion.

[33]  Janne Riihijärvi,et al.  Measuring Complexity and Predictability in Networks with Multiscale Entropy Analysis , 2009, IEEE INFOCOM 2009.

[34]  J. Álvarez-Ramírez,et al.  Multiscale entropy analysis of crude oil price dynamics , 2011 .

[35]  C. Peng,et al.  Analysis of complex time series using refined composite multiscale entropy , 2014 .

[36]  Qian Zhao,et al.  Optimizing broadcast duration for layered video streams in cellular networks , 2016, Peer-to-Peer Networking and Applications.

[37]  S M Pincus,et al.  Approximate entropy as a measure of system complexity. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[38]  Yong Zhang,et al.  Traffic Regulation based Congestion Control algorithm in Sensor Networks , 2014, J. Inf. Hiding Multim. Signal Process..

[39]  Shuen-De Wu,et al.  Refined Composite Multiscale Permutation Entropy to Overcome Multiscale Permutation Entropy Length Dependence , 2015, IEEE Signal Processing Letters.

[40]  Zhang Lon,et al.  Assessment of rolling element bearing fault severity using multi-scale entropy , 2014 .