Multichannel dynamic modeling of non-Gaussian mixtures

Abstract This paper presents a novel method that combines coupled hidden Markov models (HMM) and non-Gaussian mixture models based on independent component analyzer mixture models (ICAMM). The proposed method models the joint behavior of a number of synchronized sequential independent component analyzer mixture models (SICAMM), thus we have named it generalized SICAMM (G-SICAMM). The generalization allows for flexible estimation of complex data densities, subspace classification, blind source separation, and accurate modeling of both local and global dynamic interactions. In this work, the structured result obtained by G-SICAMM was used in two ways: classification and interpretation. Classification performance was tested on an extensive number of simulations and a set of real electroencephalograms (EEG) from epileptic patients performing neuropsychological tests. G-SICAMM outperformed the following competitive methods: Gaussian mixture models, HMM, Coupled HMM, ICAMM, SICAMM, and a long short-term memory (LSTM) recurrent neural network. As for interpretation, the structured result returned by G-SICAMM on EEGs was mapped back onto the scalp, providing a set of brain activations. These activations were consistent with the physiological areas activated during the tests, thus proving the ability of the method to deal with different kind of data densities and changing non-stationary and non-linear brain dynamics.

[1]  Karl J. Friston,et al.  Effective Connectivity Reveals Right-Hemisphere Dominance in Audiospatial Perception: Implications for Models of Spatial Neglect , 2014, The Journal of Neuroscience.

[2]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[3]  Saeid Sanei,et al.  EEG signal processing , 2000, Clinical Neurophysiology.

[4]  Addisson Salazar,et al.  Multiclass Alpha Integration of Scores from Multiple Classifiers , 2019, Neural Computation.

[5]  Michael I. Jordan,et al.  Factorial Hidden Markov Models , 1995, Machine Learning.

[6]  Ling Shao,et al.  Realistic action recognition via sparsely-constructed Gaussian processes , 2014, Pattern Recognit..

[7]  Marco Grzegorczyk,et al.  Modelling non-stationary dynamic gene regulatory processes with the BGM model , 2011, Comput. Stat..

[8]  Hans R. Künsch,et al.  Mixture ensemble Kalman filters , 2013, Comput. Stat. Data Anal..

[9]  P. Fernández-Berrocal,et al.  Performance on emotional tasks engaging cognitive control depends on emotional intelligence abilities: an ERP study , 2017, Scientific Reports.

[10]  Aapo Hyvärinen,et al.  Statistical Models of Natural Images and Cortical Visual Representation , 2010, Top. Cogn. Sci..

[11]  Oliver C. Ibe,et al.  Markov processes for stochastic modeling , 2008 .

[12]  Arnaud Delorme,et al.  Frontal midline EEG dynamics during working memory , 2005, NeuroImage.

[13]  Alfredo Robles,et al.  Spanish multicenter normative studies (Neuronorma project): norms for the abbreviated Barcelona Test. , 2011, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[14]  Julie A. E. Christensen,et al.  Validation of a novel automatic sleep spindle detector with high performance during sleep in middle aged subjects , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  Mohamed Moshrefi-Torbati,et al.  Signal processing techniques applied to human sleep EEG signals - A review , 2014, Biomed. Signal Process. Control..

[16]  Ernst Fernando Lopes Da Silva Niedermeyer,et al.  Electroencephalography, basic principles, clinical applications, and related fields , 1982 .

[17]  Qingfu Zhang,et al.  A Preference-Based Multiobjective Evolutionary Approach for Sparse Optimization , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[18]  C. Neuper,et al.  Event-related dynamics of brain oscillations , 2006 .

[19]  Addisson Salazar,et al.  New Applications of Sequential ICA Mixtures Models Compared with Dynamic Bayesian Networks for EEG Signal Processing , 2013, 2013 Fifth International Conference on Computational Intelligence, Communication Systems and Networks.

[20]  Ninad Thakoor,et al.  Understanding pollen tube growth dynamics using the Unscented Kalman Filter , 2016, Pattern Recognit. Lett..

[21]  Rubén San-Segundo-Hernández,et al.  Frequency features and GMM-UBM approach for gait-based person identification using smartphone inertial signals , 2016, Pattern Recognit. Lett..

[22]  Kazunori Iwata,et al.  Marginalized Viterbi algorithm for hierarchical hidden Markov models , 2013, Pattern Recognit..

[23]  R. Oostenveld,et al.  Independent EEG Sources Are Dipolar , 2012, PloS one.

[24]  William P. Marnane,et al.  Discriminative and Generative Classification Techniques Applied to Automated Neonatal Seizure Detection , 2013, IEEE Journal of Biomedical and Health Informatics.

[25]  Addisson Salazar,et al.  Probabilistic Distance for Mixtures of Independent Component Analyzers , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Alfred O. Hero,et al.  Dynamic Stochastic Blockmodels for Time-Evolving Social Networks , 2014, IEEE Journal of Selected Topics in Signal Processing.

[27]  Ian Daly,et al.  Brain computer interface control via functional connectivity dynamics , 2012, Pattern Recognit..

[28]  Ruimao Zhang,et al.  Progressively diffused networks for semantic visual parsing , 2019, Pattern Recognit..

[29]  Terrence J. Sejnowski,et al.  ICA Mixture Models for Unsupervised Classification of Non-Gaussian Classes and Automatic Context Switching in Blind Signal Separation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Matilde Leonardi,et al.  Sleep patterns associated with the severity of impairment in a large cohort of patients with chronic disorders of consciousness , 2017, Clinical Neurophysiology.

[31]  Wolfram Burgard,et al.  Deep learning with convolutional neural networks for EEG decoding and visualization , 2017, Human brain mapping.

[32]  Alfons Juan-Císcar,et al.  Handwriting word recognition using windowed Bernoulli HMMs , 2014, Pattern Recognit. Lett..

[33]  Vladimir S Fonov,et al.  Network connectivity determines cortical thinning in early Parkinson’s disease progression , 2017, Nature Communications.

[34]  Jacek Tabor,et al.  ICA based on asymmetry , 2017, Pattern Recognit..

[35]  Addisson Salazar,et al.  Semi-blind source extraction of atrial activity by combining statistical and spectral features , 2011, Digit. Signal Process..

[36]  Addisson Salazar,et al.  A general procedure for learning mixtures of independent component analyzers , 2010, Pattern Recognit..

[37]  Lei Xie,et al.  A coupled HMM approach to video-realistic speech animation , 2007, Pattern Recognit..

[38]  Eric Moulines,et al.  Inference in hidden Markov models , 2010, Springer series in statistics.

[39]  Debi Prosad Dogra,et al.  Coupled HMM-based multi-sensor data fusion for sign language recognition , 2017, Pattern Recognit. Lett..

[40]  Andrew J. Viterbi,et al.  Error bounds for convolutional codes and an asymptotically optimum decoding algorithm , 1967, IEEE Trans. Inf. Theory.

[41]  Addisson Salazar,et al.  On including sequential dependence in ICA mixture models , 2010, Signal Process..

[42]  Luis Montesano,et al.  Decoding Upper Limb Movement Attempt From EEG Measurements of the Contralesional Motor Cortex in Chronic Stroke Patients , 2017, IEEE Transactions on Biomedical Engineering.

[43]  Minyoung Kim Mixtures of Conditional Random Fields for Improved Structured Output Prediction , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[44]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[45]  David R. Anderson,et al.  Model selection and inference : a practical information-theoretic approach , 2000 .

[46]  Pierre Comon,et al.  Handbook of Blind Source Separation: Independent Component Analysis and Applications , 2010 .