A semi-supervised inattention detection method using biological signal

Recently, operations research methods have been utilized for biological data analysis as a huge amount of biological data becomes available. One of popular applications of the data analysis is inattention detection of operators in human–machine interaction systems using electroencephalography (EEG) signal. Most of the previous studies on the inattention detection employed supervised learning approaches, but their results have potential bias since they rely on imperfect assumptions for the acquisition of mental state labels, attention and inattention, due to the absence of the standardized measure for the mental states. Instead, we consider unsupervised learning approach, where no labeled data is required. In order to address the low performance of unsupervised learning approaches, attention duration for which an operator sustains his/her attention from the beginning of performing a task and relevance levels between four attributes of EEG signal and mental states are exploited. In this regard, we propose a semi-supervised inattention detection method (SID), in which attention duration and attributes-weights of EEG signal are respectively utilized as a small portion of labeled data for semi-supervised learning and weights for similarity calculation. Specifically, cumulative sum algorithm is used for the determination of the attention duration, and constrained attributes-weighting clustering algorithm is used for the estimation of attributes-weights. From experiments using real-world dataset, SID outperformed the compared methods, and it is expected that the adoption of SID will contribute to the enhancement of the operators’ safety.

[1]  Alessandro De Gloria,et al.  Exploiting Real-Time EEG Analysis for Assessing Flow in Games , 2012, 2012 IEEE 12th International Conference on Advanced Learning Technologies.

[2]  Bin Yang,et al.  Camera-based drowsiness reference for driver state classification under real driving conditions , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[3]  Jianping Liu,et al.  EEG-based estimation of mental fatigue by using KPCA-HMM and complexity parameters , 2010, Biomed. Signal Process. Control..

[4]  Nor Ashidi Mat Isa,et al.  Automated two-dimensional K-means clustering algorithm for unsupervised image segmentation , 2013, Comput. Electr. Eng..

[5]  Murat Kaya,et al.  Detecting the attention state of an operator in continuous attention task using EEG-based brain-computer interface , 2015, 2015 23nd Signal Processing and Communications Applications Conference (SIU).

[6]  S V Selishchev,et al.  Classification of human sleep stages based on EEG processing using hidden Markov models , 2007, Meditsinskaia tekhnika.

[7]  Necmettin Sezgin,et al.  Estimating vigilance level by using EEG and EMG signals , 2008, Neural Computing and Applications.

[8]  J. Subhashini,et al.  An efficient brain tumor detection methodology using K-means clustering algoriftnn , 2013, 2013 International Conference on Communication and Signal Processing.

[9]  Hichem Frigui,et al.  Unsupervised learning of prototypes and attribute weights , 2004, Pattern Recognit..

[10]  Sara Lal,et al.  Comparing combinations of EEG activity in train drivers during monotonous driving , 2011, Expert Syst. Appl..

[11]  Michelle N. Lumicao,et al.  EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. , 2007, Aviation, space, and environmental medicine.

[12]  Bao-Liang Lu,et al.  Dynamic clustering for vigilance analysis based on EEG , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  Mervyn V. M. Yeo,et al.  Can SVM be used for automatic EEG detection of drowsiness during car driving , 2009 .

[14]  Michael K. Ng,et al.  An optimization algorithm for clustering using weighted dissimilarity measures , 2004, Pattern Recognit..

[15]  John A. Caldwell,et al.  EEG Data Collected From Helicopter Pilots in Flight Are Sufficiently Sensitive to Detect Increased Fatigue From Sleep Deprivation , 2002 .

[16]  Jeff Van-West,et al.  Microsoft Flight Simulator For Real Pilots: Real World Training , 2007 .

[17]  N. Mackworth The Breakdown of Vigilance during Prolonged Visual Search 1 , 1948 .

[18]  Jacek Blazewicz,et al.  Some operations research methods for analyzing protein sequences and structures , 2010, Ann. Oper. Res..

[19]  Yerim Choi,et al.  A CONDITIONAL FEATURE UTILIZATION APPROACH TO ITEMSET RETRIEVAL IN ONLINE SHOPPING SERVICES , 2014 .

[20]  T. Åkerstedt,et al.  Validation of the Karolinska sleepiness scale against performance and EEG variables , 2006, Clinical Neurophysiology.

[21]  R Parasuraman,et al.  Visual sustained attention: image degradation produces rapid sensitivity decrement over time. , 1983, Science.

[22]  Andry Rakotonirainy,et al.  Real-time performance modelling of a Sustained Attention to Response Task , 2010, Ergonomics.

[23]  A. Craig,et al.  Driver fatigue: electroencephalography and psychological assessment. , 2002, Psychophysiology.

[24]  David Ríos Insua,et al.  Policy analysis and policy analytics , 2016, Ann. Oper. Res..

[25]  P. R. Davidson,et al.  Frequent lapses of responsiveness during an extended visuomotor tracking task in non‐sleep‐deprived subjects , 2006, Journal of sleep research.

[26]  Jonghun Park,et al.  Hypovigilance Detection for UCAV Operators Based on a Hidden Markov Model , 2014, Comput. Math. Methods Medicine.

[27]  Bart Verkuil,et al.  EEG theta/beta ratio as a potential biomarker for attentional control and resilience against deleterious effects of stress on attention , 2013, Cognitive, Affective, & Behavioral Neuroscience.

[28]  Chunhong Pan,et al.  Robust level set image segmentation via a local correntropy-based K-means clustering , 2014, Pattern Recognit..

[29]  J. Zeitlhofer,et al.  The assessment of vigilance: normative data on the Siesta sustained attention test. , 2013, Sleep medicine.

[30]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[31]  Jacques Bergeron,et al.  Monotony of road environment and driver fatigue: a simulator study. , 2003, Accident; analysis and prevention.

[32]  Yan Yang,et al.  Estimating vigilance from EEG using manifold clustering guided by instantaneous lapse rate , 2015, 2015 10th International Conference on Information, Communications and Signal Processing (ICICS).

[33]  Okyoung Na,et al.  The Cusum Test for Parameter Change in Time Series Models , 2003 .

[34]  W. Klimesch,et al.  Induced alpha band power changes in the human EEG and attention , 1998, Neuroscience Letters.

[35]  Charles Elkan,et al.  Learning classifiers from only positive and unlabeled data , 2008, KDD.

[36]  W. Art Chaovalitwongse,et al.  Electroencephalogram (EEG) time series classification: Applications in epilepsy , 2006, Ann. Oper. Res..

[37]  M. Jeng,et al.  Driver fatigue and highway driving: A simulator study , 2008, Physiology & Behavior.

[38]  Yinjing Guo,et al.  Vigilance analysis based on EEG band power using Support Vector Machine , 2015, 2015 8th International Congress on Image and Signal Processing (CISP).

[39]  T. Egner,et al.  EEG Biofeedback of low beta band components: frequency-specific effects on variables of attention and event-related brain potentials , 2004, Clinical Neurophysiology.

[40]  Jianjun Wang,et al.  A review of the commercial brain-computer interface technology from perspective of industrial robotics , 2010, 2010 IEEE International Conference on Automation and Logistics.

[41]  Hong Yu,et al.  Semi-Supervised Clustering for Vigilance Analysis Based on EEG , 2007, 2007 International Joint Conference on Neural Networks.

[42]  Javier M. Moguerza,et al.  A multi-stage method for content classification and opinion mining on weblog comments , 2013, Annals of Operations Research.

[43]  A. Belyavin,et al.  Changes in electrical activity of the brain with vigilance. , 1987, Electroencephalography and clinical neurophysiology.

[44]  Qiang Ji,et al.  Real Time Visual Cues Extraction for Monitoring Driver Vigilance , 2001, ICVS.

[45]  T. Fernández,et al.  EEG delta activity: an indicator of attention to internal processing during performance of mental tasks. , 1996, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[46]  A. Craig,et al.  Regional brain wave activity changes associated with fatigue. , 2012, Psychophysiology.

[47]  Chongxun Zheng,et al.  Electroencephalogram and electrocardiograph assessment of mental fatigue in a driving simulator. , 2012, Accident; analysis and prevention.

[48]  Qianmei Feng,et al.  A mathematical framework for sequential passenger and baggage screening to enhance aviation security , 2009, Comput. Ind. Eng..

[49]  E. Soetens,et al.  Psychophysiological investigation of vigilance decrement: Boredom or cognitive fatigue? , 2008, Physiology & Behavior.

[50]  Prabin Kumar Padhy,et al.  APPLICATION OF S-TRANSFORM FOR AUTOMATED DETECTION OF VIGILANCE LEVEL USING EEG SIGNALS , 2016 .

[51]  박종헌,et al.  BCI 기반 무인기 조종사 집중도 유지 지상 통제 프레임워크 , 2013 .

[52]  Oscal T.-C. Chen,et al.  EEG pattern recognition-arousal states detection and classification , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[53]  Andero Uusberg,et al.  EEG alpha and cortical inhibition in affective attention. , 2013, International Journal of Psychophysiology.

[54]  Venkatesh Balasubramanian,et al.  EEG based analysis of cognitive fatigue during simulated driving , 2011 .

[55]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[56]  Jonghun Park,et al.  Language independent semantic kernels for short-text classification , 2014, Expert Syst. Appl..

[57]  Jian Xu,et al.  A Vehicle Active Safety Model: Vehicle Speed Control Based on Driver Vigilance Detection Using Wearable EEG and Sparse Representation , 2016, Sensors.

[58]  T. M. Nelson,et al.  Development of fatigue symptoms during simulated driving. , 1997, Accident; analysis and prevention.

[59]  Arindam Banerjee,et al.  Semi-supervised Clustering by Seeding , 2002, ICML.

[60]  Stefan Haufe,et al.  EEG potentials predict upcoming emergency brakings during simulated driving , 2011, Journal of neural engineering.