An RBF-LVQPNN model and its application to time-varying signal classification

A novel technique is proposed for maintaining the diversity of sample features and modeling imbalanced datasets in multi-channel time-varying signal classification. The RBF-LVQPNN consists of a time-varying signal input layer, an RBF process neuron hidden layer, an LVQ competition layer, a pattern layer, and a classifier. Dynamic clustering was used to divide samples in each pattern class into several pattern subclasses with similar features. Typical signal samples in the pattern subclasses are then used as the kernel centers for RBFPNs, to achieve embedding of the diversity signal class features. The output of the RBFPN layer was used as input to the LVQN. In the competition layer, the ‘winning’ neurons were selected to represent a pattern subclass. In the process of reorganizing pattern subclasses into pattern classes, subclass boundaries were combined into irregular class boundaries to reduce the overlap of decision spaces for different pattern classes. The RBF-LVQNN could improve the memory ability of typical signal features and discriminability of signals, realize structural and data constraints of the model, and improve the modeling property of imbalanced datasets. In this paper, the properties of the RBF-LVQPNN are analyzed and a comprehensive training algorithm is established. Experimental validation was performed with classification diagnoses from seven types of cardiovascular diseases based on 12-lead ECG signals. Results demonstrated that the proposed technique significantly improved both classification accuracy and generalizability comparing with other methods in the experiment.

[1]  Boudewijn P. F. Lelieveldt,et al.  Optimal design of radial basis function neural networks for fuzzy-rule extraction in high dimensional data , 2002, Pattern Recognit..

[2]  Duc Truong Pham,et al.  Control chart pattern recognition using learning vector quantization networks , 1994 .

[3]  Narasimhan Sundararajan,et al.  Radial Basis Function Neural Networks With Sequential Learning: Mran and Its Applications , 1999 .

[4]  Faiza Charfi,et al.  Enhanced approach for ECG classification based on wavelet transform and decision tree models , 2013, J. Decis. Syst..

[5]  Stephen Grossberg,et al.  The ART of adaptive pattern recognition by a self-organizing neural network , 1988, Computer.

[6]  Narissara Eiamkanitchat,et al.  The Adaptive Dynamic Clustering Neuro-Fuzzy System for Classification , 2015 .

[7]  Martin A. Riedmiller,et al.  Deep auto-encoder neural networks in reinforcement learning , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[8]  Geoffrey E. Hinton,et al.  Learning Multilevel Distributed Representations for High-Dimensional Sequences , 2007, AISTATS.

[9]  Meng Joo Er,et al.  Face recognition with radial basis function (RBF) neural networks , 2002, IEEE Trans. Neural Networks.

[10]  Christian Sohler,et al.  Clustering time series under the Fréchet distance , 2015, SODA.

[11]  Jin Qi,et al.  ECG Characteristic Wave Detection Based on Deep Recursive Long Short-Term Memory , 2019, J. Medical Imaging Health Informatics.

[12]  Qiang Zhang,et al.  Classification of ECG signals based on 1D convolution neural network , 2017, 2017 IEEE 19th International Conference on e-Health Networking, Applications and Services (Healthcom).

[13]  Riccardo Rovatti,et al.  Rakeness-based approach to compressed sensing of ECGs , 2011, 2011 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[14]  D. Broomhead,et al.  Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .

[15]  Nicolaos B. Karayiannis,et al.  A methodology for constructing fuzzy algorithms for learning vector quantization , 1997, IEEE Trans. Neural Networks.

[16]  Jichao Zhao,et al.  Robust ECG signal classification for detection of atrial fibrillation using a novel neural network , 2017, 2017 Computing in Cardiology (CinC).

[17]  J. Bezdek,et al.  FCM: The fuzzy c-means clustering algorithm , 1984 .

[18]  Xia Liu,et al.  Ccdd: an Enhanced Standard ECG Database with its Management and Annotation Tools , 2012, Int. J. Artif. Intell. Tools.

[19]  Pietro Burrascano,et al.  Learning vector quantization for the probabilistic neural network , 1991, IEEE Trans. Neural Networks.

[20]  Ali Hamzeh,et al.  DBFS: An effective Density Based Feature Selection scheme for small sample size and high dimensional imbalanced data sets , 2012, Data Knowl. Eng..

[21]  Ricardo J. G. B. Campello,et al.  Density-Based Clustering Based on Hierarchical Density Estimates , 2013, PAKDD.

[22]  Biao Leng,et al.  Data augmentation for unbalanced face recognition training sets , 2017, Neurocomputing.

[23]  Jonathan Le Roux,et al.  Phase-sensitive and recognition-boosted speech separation using deep recurrent neural networks , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Long Cheng,et al.  Learning impedance control of robots with enhanced transient and steady-state control performances , 2020, Science China Information Sciences.

[25]  Chris Bishop,et al.  Improving the Generalization Properties of Radial Basis Function Neural Networks , 1991, Neural Computation.

[26]  Eamonn J. Keogh,et al.  Derivative Dynamic Time Warping , 2001, SDM.

[27]  Huaguang Zhang,et al.  Identification method for a class of periodic discrete-time dynamic nonlinear systems based on Sinusoidal ESN , 2018, Neurocomputing.

[28]  Xue-wen Chen,et al.  Combating the Small Sample Class Imbalance Problem Using Feature Selection , 2010, IEEE Transactions on Knowledge and Data Engineering.

[29]  Shaocheng Tong,et al.  Adaptive neural network tracking design for a class of uncertain nonlinear discrete-time systems with dead-zone , 2012, Science China Information Sciences.

[30]  Hamid Reza Karimi,et al.  Control of uncertain highly nonlinear biological process based on Takagi-Sugeno fuzzy models , 2015, Signal Process..

[31]  Witold Pedrycz,et al.  ECG Signal Processing, Classification and Interpretation: A Comprehensive Framework of Computational Intelligence , 2011 .

[32]  Teuvo Kohonen,et al.  A Simple Paradigm for the Self-Organized Formation of Structured Feature Maps , 1982 .

[33]  Antonia Papandreou-Suppappola,et al.  Applications in Time-Frequency Signal Processing , 2002 .

[34]  Amera Almas,et al.  Enhancing the performance of decision tree: A research study of dealing with unbalanced data , 2012, Seventh International Conference on Digital Information Management (ICDIM 2012).

[35]  Deepta Rajan,et al.  A Generative Modeling Approach to Limited Channel ECG Classification , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[36]  Wang Fei,et al.  Research on speech emotion recognition based on deep auto-encoder , 2016, 2016 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER).

[37]  Ramesh Kumar Sunkaria,et al.  Inferior myocardial infarction detection using stationary wavelet transform and machine learning approach , 2017, Signal, Image and Video Processing.

[38]  Ja-Chen Lin,et al.  A new LDA-based face recognition system which can solve the small sample size problem , 1998, Pattern Recognit..

[39]  Yi Zheng,et al.  Time Series Classification Using Multi-Channels Deep Convolutional Neural Networks , 2014, WAIM.

[40]  Kun Liu,et al.  A radial basis probabilistic process neural network model and corresponding classification algorithm , 2019, Applied Intelligence.

[41]  Anni Cai,et al.  Enhanced and hierarchical structure algorithm for data imbalance problem in semantic extraction under massive video dataset , 2012, Multimedia Tools and Applications.

[42]  José Luis Díez,et al.  Dynamic clustering of residential electricity consumption time series data based on Hausdorff distance , 2016 .

[43]  Lovekesh Vig,et al.  Anomaly detection in ECG time signals via deep long short-term memory networks , 2015, 2015 IEEE International Conference on Data Science and Advanced Analytics (DSAA).

[44]  Witold Pedrycz,et al.  ECG Signal Analysis, Classification, and Interpretation: A Framework of Computational Intelligence , 2012 .

[45]  Shaocheng Tong,et al.  Integral Barrier Lyapunov function-based adaptive control for switched nonlinear systems , 2020, Science China Information Sciences.

[46]  Mehmet Korürek,et al.  ECG beat classification using particle swarm optimization and radial basis function neural network , 2010, Expert Syst. Appl..

[47]  Teuvo Kohonen,et al.  Improved versions of learning vector quantization , 1990, 1990 IJCNN International Joint Conference on Neural Networks.