A novel reinforcement learning framework for online adaptive seizure prediction

Epileptic seizure prediction is still a very challenging and unsolved problem for medical professionals. The current bottleneck of seizure prediction techniques is the lack of flexibility for different patients with an incredible variety of epileptic seizures. This study proposes a novel self-adaptation mechanism which successfully combines reinforcement learning, online monitoring and adaptive control theory for seizure prediction. The proposed method eliminates a sophisticated threshold-tuning/optimization process, and has a great potential of flexibility and adaptability to a wide range of patients with various types of seizures. The proposed prediction system was tested on five patients with epilepsy. With the best parameter settings, it achieved an averaged accuracy of 71.34%, which is considerably better than a chance model. The autonomous adaptation property of the system offers a promising path towards development of practical online seizure prediction techniques for physicians and patients.

[1]  R. Quiroga,et al.  Kulback-Leibler and renormalized entropies: applications to electroencephalograms of epilepsy patients. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[2]  Alexandre Andrade,et al.  Correlation Dimension Maps of EEG from Epileptic Absences , 1999, Brain Topography.

[3]  Klaus Lehnertz,et al.  Testing the null hypothesis of the nonexistence of a preseizure state. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  Lipo Wang,et al.  Data Mining With Computational Intelligence , 2006, IEEE Transactions on Neural Networks.

[5]  Deng-Shan Shiau,et al.  Predictability Analysis for an Automated Seizure Prediction Algorithm , 2006, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[6]  Klaus Lehnertz,et al.  Measure profile surrogates: a method to validate the performance of epileptic seizure prediction algorithms. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[7]  A. Kraskov,et al.  On the predictability of epileptic seizures , 2005, Clinical Neurophysiology.

[8]  P. Pardalos,et al.  Performance of a seizure warning algorithm based on the dynamics of intracranial EEG , 2005, Epilepsy Research.

[9]  W. Art Chaovalitwongse,et al.  Adaptive epileptic seizure prediction system , 2003, IEEE Transactions on Biomedical Engineering.

[10]  Alistair I. Mees,et al.  Dynamics of brain electrical activity , 2005, Brain Topography.

[11]  Timothy A. Pedley,et al.  Epilepsy : a comprehensive textbook , 2008 .

[12]  J. Cramer,et al.  Quality of life for people with epilepsy. , 1994, Neurologic clinics.

[13]  S. Huffel,et al.  Anticipation of epileptic seizures from standard EEG recordings , 2003, The Lancet.

[14]  C. Elger,et al.  CAN EPILEPTIC SEIZURES BE PREDICTED? EVIDENCE FROM NONLINEAR TIME SERIES ANALYSIS OF BRAIN ELECTRICAL ACTIVITY , 1998 .

[15]  M Sachs [Anatomy of the brain]. , 1982, Soins; la revue de reference infirmiere.

[16]  K. Lehnertz,et al.  The First International Collaborative Workshop on Seizure Prediction: summary and data description , 2005, Clinical Neurophysiology.

[17]  Leonidas D. Iasemidis,et al.  On the dynamics of the human brain in temporal lobe epilepsy. , 1991 .

[18]  Viglione Ss,et al.  Proceedings: Epileptic seizure prediction. , 1975 .

[19]  F. Mormann,et al.  Seizure prediction: the long and winding road. , 2007, Brain : a journal of neurology.

[20]  T. Tomson,et al.  Risk of Extremity Fractures in Adult Outpatients with Epilepsy , 2002, Epilepsia.

[21]  E. J. Kostelich,et al.  Comparison of Algorithms for Determining Lyapunov Exponents from Experimental Data , 1986 .

[22]  A. Schulze-Bonhage,et al.  How well can epileptic seizures be predicted? An evaluation of a nonlinear method. , 2003, Brain : a journal of neurology.

[23]  A. Kanemitsu,et al.  [Anatomy of the brain]. , 1987, Nihon rinsho. Japanese journal of clinical medicine.

[24]  S. Huffel,et al.  Anticipation of epileptic seizures from standard EEG recordings , 2003, The Lancet.

[25]  Pavel Senin,et al.  Dynamic Time Warping Algorithm Review , 2008 .

[26]  A. Schulze-Bonhage,et al.  The seizure prediction characteristic: a general framework to assess and compare seizure prediction methods , 2003, Epilepsy & Behavior.

[27]  Deborah Buck,et al.  Quality of Life of People with Epilepsy: A European Study , 1997, Epilepsia.