Range-Based ICA Using a Nonsmooth Quasi-Newton Optimizer for Electroencephalographic Source Localization in Focal Epilepsy

Independent component analysis (ICA) aims at separating a multivariate signal into independent nongaussian signals by optimizing a contrast function with no knowledge on the mixing mechanism. Despite the availability of a constellation of contrast functions, a Hartley-entropy–based ICA contrast endowed with the discriminacy property makes it an appealing choice as it guarantees the absence of mixing local optima. Fueled by an outstanding source separation performance of this contrast function in practical instances, a succession of optimization techniques has recently been adopted to solve the ICA problem. Nevertheless, the nondifferentiability of the considered contrast restricts the choice of the optimizer to the class of derivative-free methods. On the contrary, this letter concerns a Riemannian quasi-Newton scheme involving an explicit expression for the gradient to optimize the contrast function that is differentiable almost everywhere. Furthermore, the inexact line search insisting on the weak Wolfe condition and a terminating criterion befitting the partly smooth function optimization have been generalized to manifold settings, leaving the previous results intact. The investigations with diversified images and the electroencephalographic (EEG) data acquired from 45 focal epileptic subjects demonstrate the efficacy of our approach in terms of computational savings and reliable EEG source localization, respectively. Additional experimental results are available in the online supplement.

[1]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[2]  Bjarne K. Ersbøll,et al.  FAME-a flexible appearance modeling environment , 2003, IEEE Transactions on Medical Imaging.

[3]  Robert E. Mahony,et al.  Optimization Algorithms on Matrix Manifolds , 2007 .

[4]  C. Panayiotopoulos A Clinical Guide to Epileptic Syndromes and Their Treatment, 2nd ed. , 2002, American Journal of Neuroradiology.

[5]  Saeid Sanei,et al.  Localization of Abnormal EEG Sources Incorporating Constrained BSS , 2005, ICANN.

[6]  Saeid Sanei,et al.  Seizure source localization using a hybrid second order blind identification and extended rival penalized competitive learning algorithm , 2009, Biomed. Signal Process. Control..

[7]  Michel Verleysen,et al.  Non-orthogonal Support Width ICA , 2006, ESANN.

[8]  Jan Rémi,et al.  The role of EEG in epilepsy: A critical review , 2009, Epilepsy & Behavior.

[9]  I. Coope,et al.  Performance of various BFGS implementations with limited precision second-order information , 2004, The ANZIAM Journal.

[10]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[11]  Roger Weis,et al.  A Clinical Guide to Epileptic Syndromes and their Treatment , 2004 .

[12]  Juri D. Kropotov,et al.  Independent component approach to the analysis of EEG recordings at early stages of depressive disorders , 2010, Clinical Neurophysiology.

[13]  R. Gulrajani Bioelectricity and biomagnetism , 1998 .

[14]  R. Oostenveld,et al.  Independent EEG Sources Are Dipolar , 2012, PloS one.

[15]  Michel Verleysen,et al.  A Minimum-Range Approach to Blind Extraction of Bounded Sources , 2007, IEEE Transactions on Neural Networks.

[16]  Matthew T. Sutherland,et al.  Validation of SOBI components from high-density EEG , 2005, NeuroImage.

[17]  Pierre-Antoine Absil,et al.  Range-based non-orthogonal ICA using cross-entropy method , 2012, ESANN.

[18]  Lotfi Senhadji,et al.  One Decade of Biomedical Problems Using ICA: A Full Comparative Study , 2009 .

[19]  Patrick Dupont,et al.  ICA Extracts Epileptic Sources from fMRI in EEG-Negative Patients: A Retrospective Validation Study , 2013, PloS one.

[20]  Dinh-Tuan Pham,et al.  Local minima of information-theoretic criteria in blind source separation , 2005, IEEE Signal Processing Letters.

[21]  Christian Jutten,et al.  On the blind source separation of human electroencephalogram by approximate joint diagonalization of second order statistics , 2008, Clinical Neurophysiology.

[22]  Michel Verleysen,et al.  On the Risk of Using RÉnyi's Entropy for Blind Source Separation , 2008, IEEE Transactions on Signal Processing.

[23]  T. Sejnowski,et al.  Removing electroencephalographic artifacts by blind source separation. , 2000, Psychophysiology.

[24]  Scott Makeig,et al.  ERP Features and EEG Dynamics : An ICA Perspective , 2009 .

[25]  U. Helmke,et al.  Nonsmooth Riemannian Optimization with Applications to Sphere Packing and Grasping , 2007 .

[26]  Deniz Erdoğmuş,et al.  Blind source separation using Renyi's mutual information , 2001, IEEE Signal Processing Letters.

[27]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[28]  Aapo Hyv Fast and Robust Fixed-Point Algorithms for Independent Component Analysis , 1999 .

[29]  S. Easter Selvan,et al.  Nonsmooth ICA Contrast Minimization Using a Riemannian Nelder–Mead Method , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Terrence J. Sejnowski,et al.  Complex Independent Component Analysis of Frequency-Domain Electroencephalographic Data , 2003, Neural Networks.

[31]  Wen Huang,et al.  Optimization algorithms on Riemannian manifolds with applications , 2013 .

[32]  José Carlos Príncipe,et al.  A Unified Framework for Quadratic Measures of Independence , 2011, IEEE Transactions on Signal Processing.

[33]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[34]  A. Rényi,et al.  Calcul des probabilités , 1966 .

[35]  Tülay Adali,et al.  Independent Component Analysis by Entropy Bound Minimization , 2010, IEEE Transactions on Signal Processing.

[36]  M. Verleysen,et al.  A Least Absolute Bound Approach to ICA - Application to the MLSP 2006 Competition , 2006, 2006 16th IEEE Signal Processing Society Workshop on Machine Learning for Signal Processing.

[37]  Berend Jan van der Zwaag,et al.  Detecting Epileptic Seizure Activity in the EEG by Independent Component Analysis , 2003 .

[38]  A. Walker Electroencephalography, Basic Principles, Clinical Applications and Related Fields , 1982 .

[39]  W. De Clercq,et al.  Automatic Removal of Ocular Artifacts in the EEG without an EOG Reference Channel , 2006, Proceedings of the 7th Nordic Signal Processing Symposium - NORSIG 2006.

[40]  Sabine Van Huffel,et al.  Independent Component Analysis (ICA) methods for neonatal EEG artifact extraction: Sensitivity to variation of artifact properties , 2010, 10th Symposium on Neural Network Applications in Electrical Engineering.

[41]  Thomas George Selvaraj,et al.  EEG Database of Seizure Disorders for Experts and Application Developers , 2014, Clinical EEG and neuroscience.

[42]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[43]  O. Pascalis,et al.  Independent Component Analysis Reveals Atypical Electroencephalographic Activity During Visual Perception in Individuals with Autism , 2009, Biological Psychiatry.

[44]  Adrian S. Lewis,et al.  Nonsmooth optimization via quasi-Newton methods , 2012, Mathematical Programming.

[45]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[46]  L. Zhukov,et al.  Independent component analysis for EEG source localization , 2000, IEEE Engineering in Medicine and Biology Magazine.

[47]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[48]  T. Sejnowski,et al.  Linking brain, mind and behavior. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[49]  Frédéric Vrins,et al.  Contrast properties of entropic criteria for blind source separation : a unifying framework based on information-theoretic inequalities/ , 2007 .

[50]  C. J. Price,et al.  Effect of limited precision on the BFGS quasi-Newton algorithm , 2004 .

[51]  Bruno Alfano,et al.  Descent Algorithms on Oblique Manifold for Source-Adaptive ICA Contrast , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[52]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[53]  Pierre-Antoine Absil,et al.  Spherical Mesh Adaptive Direct Search for Separating Quasi-Uncorrelated Sources by Range-Based Independent Component Analysis , 2013, Neural Computation.

[54]  Gennady G. Knyazev,et al.  Comparison of spatial and temporal independent component analyses of electroencephalographic data: A simulation study , 2013, Clinical Neurophysiology.

[55]  Aapo Hyvärinen,et al.  Independent component analysis of short-time Fourier transforms for spontaneous EEG/MEG analysis , 2010, NeuroImage.

[56]  D. Tucker,et al.  EEG coherency. I: Statistics, reference electrode, volume conduction, Laplacians, cortical imaging, and interpretation at multiple scales. , 1997, Electroencephalography and clinical neurophysiology.

[57]  Vwani P. Roychowdhury,et al.  Independent component analysis based on nonparametric density estimation , 2004, IEEE Transactions on Neural Networks.

[58]  Sabine Van Huffel,et al.  Spatially constrained ICA algorithm with an application in EEG processing , 2011, Signal Process..