Cross-subject driver status detection from physiological signals based on hybrid feature selection and transfer learning

Abstract It is a challenging and rewarding work for monitoring driving status in daily commute, which is favorable for declining the occurrence of traffic accidents and promoting driver's health. One big challenge that restricts this kind of research from real-life applications is the robustness and transfer ability of learning methods that can effectively tackle individual difference. Drawing knowledge from others through transfer learning could boost detection performance of a new driver. The present study aims to develop an efficient cross-subject transfer learning framework for driving status detection based on physiological signals. To grasp what part of knowledge was appropriate for transferring, cross-subject feature evaluation was used to measure feature quality. Then based on the evaluation score, several filtering algorithms were combined to search for better feature subsets that were not only helpful for later classification tasks but also robust to the individual difference. Finally, the framework based on hybrid feature selection and efficient transfer classifier was validated using simulated and real driving datasets. Our experimental results revealed that the proposed algorithm could achieve high recognition accuracy and good transferability among individuals, which could increase the scope of application of physiological data for drive status detection during daily life, as it alleviated the need of subject specific pilot data for assessing the physiological characteristics across subjects. This scheme can be further developed into an online warning and assistant system in vehicles helping to early detect driver's unfavorable status, better manage their negative emotion and decrease the occurrence of traffic accidents.

[1]  Daoqiang Zhang,et al.  Manifold regularized multitask feature learning for multimodality disease classification , 2015, Human brain mapping.

[2]  Taghi M. Khoshgoftaar,et al.  An Investigation of Transfer Learning and Traditional Machine Learning Algorithms , 2016, 2016 IEEE 28th International Conference on Tools with Artificial Intelligence (ICTAI).

[3]  Anwar M. Mirza,et al.  Fully automated real time fatigue detection of drivers through Fuzzy Expert Systems , 2014, Appl. Soft Comput..

[4]  Wan-Young Chung,et al.  Driver Alertness Monitoring Using Fusion of Facial Features and Bio-Signals , 2012, IEEE Sensors Journal.

[5]  Bao-Liang Lu,et al.  EEG-Based Sleep Quality Evaluation with Deep Transfer Learning , 2017, ICONIP.

[6]  Gang Li,et al.  Detection of Driver Drowsiness Using Wavelet Analysis of Heart Rate Variability and a Support Vector Machine Classifier , 2013, Sensors.

[7]  Shiliang Sun,et al.  A survey of multi-source domain adaptation , 2015, Inf. Fusion.

[8]  Bernhard Schölkopf,et al.  Transfer Learning in Brain-Computer Interfaces , 2015, IEEE Computational Intelligence Magazine.

[9]  L. Alberto Hernández Montiel,et al.  Hybrid Framework Using Multiple-Filters and an Embedded Approach for an Efficient Selection and Classification of Microarray Data , 2016, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[10]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[11]  Bao-Liang Lu,et al.  A multimodal approach to estimating vigilance using EEG and forehead EOG , 2016, Journal of neural engineering.

[12]  Gernot R. Müller-Putz,et al.  Domain Adaptation Techniques for EEG-Based Emotion Recognition: A Comparative Study on Two Public Datasets , 2019, IEEE Transactions on Cognitive and Developmental Systems.

[13]  D. Asir Antony Gnana Singh,et al.  Literature Review on Feature Selection Methods for High-Dimensional Data , 2016 .

[14]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[15]  Lanlan Chen,et al.  Detecting driving stress in physiological signals based on multimodal feature analysis and kernel classifiers , 2017, Expert Syst. Appl..

[16]  Bo Cheng,et al.  Driver drowsiness recognition based on computer vision technology , 2012 .

[17]  Kimihiko Nakano,et al.  Biosignal Analysis to Assess Mental Stress in Automatic Driving of Trucks: Palmar Perspiration and Masseter Electromyography , 2015, Sensors.

[18]  Francisco Javier Díaz Pernas,et al.  Real-time vision-based eye state detection for driver alertness monitoring , 2013, Pattern Analysis and Applications.

[19]  Noelia Hernández,et al.  Vision-based drowsiness detector for a realistic driving simulator , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[20]  Yuan-Pin Lin,et al.  Selective Transfer Learning for EEG-Based Drowsiness Detection , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[21]  Philip S. Yu,et al.  Adaptation Regularization: A General Framework for Transfer Learning , 2014, IEEE Transactions on Knowledge and Data Engineering.

[22]  Brent Lance,et al.  Switching EEG Headsets Made Easy: Reducing Offline Calibration Effort Using Active Weighted Adaptation Regularization , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  Daniel Marcu,et al.  Domain Adaptation for Statistical Classifiers , 2006, J. Artif. Intell. Res..

[24]  Carlos Busso,et al.  Ensemble feature selection for domain adaptation in speech emotion recognition , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[25]  Philip S. Yu,et al.  Transfer Joint Matching for Unsupervised Domain Adaptation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Rongrong Fu,et al.  Dynamic driver fatigue detection using hidden Markov model in real driving condition , 2016, Expert Syst. Appl..

[27]  Jaime G. Carbonell,et al.  Feature Selection for Transfer Learning , 2011, ECML/PKDD.

[28]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[29]  Bao-Liang Lu,et al.  Transfer Components Between Subjects for EEG-based Driving Fatigue Detection , 2015, ICONIP.

[30]  Pablo Laguna,et al.  Drowsiness detection using heart rate variability , 2016, Medical & Biological Engineering & Computing.

[31]  Ao Zhang,et al.  A New Hybrid Feature Selection Algorithm Applied to Driver's Status Detection , 2017, ICONIP.

[32]  Slawomir Gruszczynski,et al.  Hybrid computer vision system for drivers' eye recognition and fatigue monitoring , 2014, Neurocomputing.

[33]  Brent Lance,et al.  Driver Drowsiness Estimation From EEG Signals Using Online Weighted Adaptation Regularization for Regression (OwARR) , 2017, IEEE Transactions on Fuzzy Systems.

[34]  J.C. Rajapakse,et al.  SVM-RFE With MRMR Filter for Gene Selection , 2010, IEEE Transactions on NanoBioscience.

[35]  Jianhua Zhang,et al.  Cross-subject mental workload classification using kernel spectral regression and transfer learning techniques , 2017, Cognition, Technology & Work.

[36]  Wan-Young Chung,et al.  Mobile Healthcare for Automatic Driving Sleep-Onset Detection Using Wavelet-Based EEG and Respiration Signals , 2014, Sensors.

[37]  Shiliang Sun,et al.  Cross-domain representation-learning framework with combination of class-separate and domain-merge objectives , 2012, CDKD '12.

[38]  Reza Ghaderi,et al.  Driver's drowsiness detection using an enhanced image processing technique inspired by the human visual system , 2016, Connect. Sci..

[39]  Marko Robnik-Sikonja,et al.  Theoretical and Empirical Analysis of ReliefF and RReliefF , 2003, Machine Learning.

[40]  Philip S. Yu,et al.  Transfer Feature Learning with Joint Distribution Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[41]  Igor Kononenko,et al.  Estimating Attributes: Analysis and Extensions of RELIEF , 1994, ECML.

[42]  Lanlan Chen,et al.  Automatic detection of alertness/drowsiness from physiological signals using wavelet-based nonlinear features and machine learning , 2015, Expert Syst. Appl..

[43]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[44]  Zhong Yin,et al.  Cross-session classification of mental workload levels using EEG and an adaptive deep learning model , 2017, Biomed. Signal Process. Control..

[45]  Eric Laciar,et al.  Automatic detection of drowsiness in EEG records based on multimodal analysis. , 2014, Medical engineering & physics.