An Adaptive Structure Neural Networks with Application to EEG Automatic Seizure Detection

This paper introduces a new algorithm for adaptively adjusting the structure of a multi-layer back-propagation network. The proposed algorithm belongs to the class of neuron generating strategies as opposed to the class of neuron pruning strategies. Initially a "small" multi-layer perceptron network is selected. The stabilized error is used as an index to determine whether the network needs to generate a new neuron or not. If after a period of learning the error is stabilized, but the error is larger than a desired value, then new neuron(s) is (are) generated. The new neurons are placed at locations that contribute most to the network error behavior through the fluctuation in their input weight vectors. Among the features of the new architecture are its improved performance and generalization capabilities compared to a standard fixed-structure back-propagation network. Application to an electroencephalogram (EEG) automatic epileptic seizure detection is presented to illustrate advantages and capabilities of the proposed algorithm. Using an actual data from five patients it is shown that the proposed approach correctly identifies all true seizures that are also identified by an expert physician. The new algorithm provides a reduction of 60-70% in the training epochs as compared to a back-propagation algorithm. Furthermore, it is shown that by utilizing a new training algorithm it is possible to reduce the false seizure detections to zero while resulting in a 5.1% error in identifying the true seizures. Copyright 1996 Elsevier Science Ltd

[1]  K. Meador,et al.  Computerized seizure detection of complex partial seizures. , 1991, Electroencephalography and clinical neurophysiology.

[2]  C.-L. Chen,et al.  Improving the training speed of three-layer feedforward neural nets by optimal estimation of the initial weights , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[3]  J Gotman,et al.  Seizure recognition and analysis. , 1985, Electroencephalography and clinical neurophysiology. Supplement.

[4]  Gregory J. Wolff,et al.  Optimal Brain Surgeon and general network pruning , 1993, IEEE International Conference on Neural Networks.

[5]  Tsu-Chang Lee,et al.  Structure level adaptation for artificial neural networks , 1991 .

[6]  M.R. Azimi-Sadjadi,et al.  Recursive node creation in back-propagation neural networks using orthogonal projection method , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[7]  J. Gotman,et al.  Improvement in seizure detection performance by automatic adaptation to the EEG of each patient. , 1993, Electroencephalography and clinical neurophysiology.

[8]  A J Gabor,et al.  Automated interictal EEG spike detection using artificial neural networks. , 1992, Electroencephalography and clinical neurophysiology.

[9]  J Gotman,et al.  State-dependent spike detection: concepts and preliminary results. , 1991, Electroencephalography and clinical neurophysiology.

[10]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[11]  Alex Waibel,et al.  Consonant recognition by modular construction of large phonemic time-delay neural networks , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[12]  Timur Ash,et al.  Dynamic node creation in backpropagation networks , 1989 .

[13]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[14]  Christian Lebiere,et al.  The Cascade-Correlation Learning Architecture , 1989, NIPS.

[15]  J. Gotman.  Automatic recognition of epileptic seizures in the EEG. , 1982, Electroencephalography and clinical neurophysiology.

[16]  A. Griewank,et al.  Automatic differentiation of algorithms : theory, implementation, and application , 1994 .

[17]  Mahmood R. Azimi-Sadjadi,et al.  Recursive dynamic node creation in multilayer neural networks , 1993, IEEE Trans. Neural Networks.

[18]  Yann LeCun,et al.  Optimal Brain Damage , 1989, NIPS.

[19]  R. M. Siegel,et al.  Pattern recognition of the electroencephalogram by artificial neural networks. , 1993, Electroencephalography and clinical neurophysiology.