A Driver State Detection System—Combining a Capacitive Hand Detection Sensor With Physiological Sensors

With respect to automotive safety, the driver plays a crucial role. Stress level, tiredness, and distraction of the driver are therefore of high interest. In this paper, a driver state detection system based on cellular neural networks (CNNs) to monitor the driver’s stress level is presented. We propose to include a capacitive-based wireless hand detection (position and touch) sensor for a steering wheel utilizing ink-jet printed sensor mats as an input sensor in order to improve the performance. A driving simulator platform providing a realistic virtual traffic environment is utilized to conduct a study with 22 participants for the evaluation of the proposed system. Each participant is driving in two different scenarios, each representing one of the two no-stress/stress driver states. A “threefold” cross validation is applied to evaluate our concept. The subject dependence is considered carefully by separating the training and testing data. Furthermore, the CNN approach is benchmarked against other state-of-the-art machine learning techniques. The results show a significant improvement combining sensor inputs from different driver inherent domains, giving a total related detection accuracy of 92%. Besides that, this paper shows that in case of including the capacitive hand detection sensor, the accuracy increases by 10%. These findings indicate that adding a subject-independent sensor, such as the proposed capacitive hand detection sensor, can significantly improve the detection performance.

[1]  Maya R. Gupta,et al.  Bayesian Quadratic Discriminant Analysis , 2007, J. Mach. Learn. Res..

[2]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[3]  Hubert Zangl,et al.  Short Range Capacitive Proximity Sensing , 2015 .

[4]  Goran Stojanovic,et al.  A Compact Inductive Position Sensor Made by Inkjet Printing Technology on a Flexible Substrate , 2012, Sensors.

[5]  John D. Lee,et al.  Real-Time Detection of Driver Cognitive Distraction Using Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[6]  L.O. Chua,et al.  Cellular neural networks , 1993, 1988., IEEE International Symposium on Circuits and Systems.

[7]  Stephen A. Billings,et al.  Generalized Cellular Neural Networks (Gcnns) Constructed Using Particle Swarm Optimization for Spatio-Temporal Evolutionary Pattern Identification , 2008, Int. J. Bifurc. Chaos.

[8]  Ulrich Büker,et al.  Object recognition in image sequences with cellular neural networks , 2000, Neurocomputing.

[9]  Tamás Roska,et al.  The CNN universal machine: an analogic array computer , 1993 .

[10]  Jean-Marc Boucher,et al.  Multisource classification using ICM and Dempster-Shafer theory , 2002, IEEE Trans. Instrum. Meas..

[11]  Richard M. Dansereau,et al.  Robust joint audio-video talker localization in video conferencing using reliability information-II: Bayesian network fusion , 2005, IEEE Transactions on Instrumentation and Measurement.

[12]  R. Homan,et al.  Cerebral location of international 10-20 system electrode placement. , 1987, Electroencephalography and clinical neurophysiology.

[13]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Keiichi Uchimura,et al.  Driver inattention monitoring system for intelligent vehicles: A review , 2009 .

[15]  Oussama Khatib,et al.  Virtual whiskers — Highly responsive robot collision avoidance , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Elisa Ricci,et al.  Cellular Neural Networks With Virtual Template Expansion for Retinal Vessel Segmentation , 2007, IEEE Transactions on Circuits and Systems II: Express Briefs.

[17]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  John D. Lee,et al.  A hybrid Bayesian Network approach to detect driver cognitive distraction , 2014 .

[19]  Mantas Lukosevicius,et al.  A Practical Guide to Applying Echo State Networks , 2012, Neural Networks: Tricks of the Trade.

[20]  Herbert Jaeger,et al.  Long Short-Term Memory in Echo State Networks: Details of a Simulation Study , 2012 .

[21]  Andrew Chi-Sing Leung,et al.  Parallelization of cellular neural networks on GPU , 2008, Pattern Recognit..

[22]  Atif Shamim,et al.  An Inkjet-Printed Buoyant 3-D Lagrangian Sensor for Real-Time Flood Monitoring , 2014, IEEE Transactions on Antennas and Propagation.

[23]  Hubert Zangl,et al.  TEDS Extensions Toward Energy Management of Wireless Transducers , 2015, IEEE Sensors Journal.

[24]  Anthony Gar-On Yeh,et al.  Neural-network-based cellular automata for simulating multiple land use changes using GIS , 2002, Int. J. Geogr. Inf. Sci..

[25]  Abdulhamit Subasi,et al.  EEG signal classification using wavelet feature extraction and a mixture of expert model , 2007, Expert Syst. Appl..

[26]  Leontios J. Hadjileontiadis,et al.  Emotion Recognition From EEG Using Higher Order Crossings , 2010, IEEE Transactions on Information Technology in Biomedicine.

[27]  Sangkil Kim,et al.  Low-Cost Inkjet-Printed Fully Passive RFID Tags for Calibration-Free Capacitive/Haptic Sensor Applications , 2015, IEEE Sensors Journal.

[28]  B. Ando,et al.  Inkjet-printed sensors: a useful approach for low cost, rapid prototyping [Instrumentation Notes] , 2011, IEEE Instrumentation & Measurement Magazine.

[29]  Amit Konar,et al.  Emotion Recognition: A Pattern Analysis Approach , 2015 .

[30]  Juha Virtanen,et al.  Inkjet-Printed Humidity Sensor for Passive UHF RFID Systems , 2011, IEEE Transactions on Instrumentation and Measurement.

[31]  Hubert Zangl,et al.  A wireless steering wheel gripping sensor for hands on/off detection , 2016, 2016 IEEE Sensors Applications Symposium (SAS).

[32]  Steffen Leonhardt,et al.  ECG on the Road: Robust and Unobtrusive Estimation of Heart Rate , 2011, IEEE Transactions on Biomedical Engineering.

[33]  H. Zangl,et al.  A Novel Seat Occupancy Detection System based on Capacitive Sensing , 2008, 2008 IEEE Instrumentation and Measurement Technology Conference.

[34]  X. Liao,et al.  Edge detection of noisy images based on cellular neural networks , 2011 .

[35]  Te-Jen Su,et al.  Particle Swarm Optimization with Time-Varying Acceleration Coefficients Based on Cellular Neural Network for Color Image Noise Cancellation , 2011 .

[36]  Min Tang,et al.  Edge Detection and Image Segmentation Based on Cellular Neural Network , 2009, 2009 3rd International Conference on Bioinformatics and Biomedical Engineering.

[37]  Stefan Lüke,et al.  Stauassistenz und -automation , 2015, Handbuch Fahrerassistenzsysteme.

[38]  Bryan Reimer,et al.  Monitoring, managing, and motivating driver safety and well-being , 2011, IEEE Pervasive Computing.

[39]  M. Benedek,et al.  Decomposition of skin conductance data by means of nonnegative deconvolution , 2010, Psychophysiology.

[40]  Daniel Dias,et al.  Inkjet Printed Pressure Sensing Platform for Postural Imbalance Monitoring , 2015, IEEE Transactions on Instrumentation and Measurement.

[41]  George S. Moschytz,et al.  Learning algorithms for cellular neural networks , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[42]  Dario Petri,et al.  Dynamic Compensation of Nonlinear Sensors by a Learning-From-Examples Approach , 2008, IEEE Transactions on Instrumentation and Measurement.

[43]  S. SanthoshKumar,et al.  A Fast Time Scale Genetic Algorithm based Image Segmentation using Cellular Neural Networks (CNN) , 2007, 2007 IEEE International Conference on Signal Processing and Communications.

[44]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[45]  Kyandoghere Kyamakya,et al.  Cellular Neural Network Trainer and Template Optimization for Advanced Robot Locomotion, Based on Genetic Algorithm , 2008, 2008 15th International Conference on Mechatronics and Machine Vision in Practice.

[46]  Herbert Jaeger,et al.  The''echo state''approach to analysing and training recurrent neural networks , 2001 .

[47]  Weizhong Yan,et al.  Toward Automatic Time-Series Forecasting Using Neural Networks , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[48]  Hosein Marzi Modular Neural Network Architecture for Precise Condition Monitoring , 2008, IEEE Transactions on Instrumentation and Measurement.

[49]  Kazuhiko Takahashi Remarks on Emotion Recognition from Bio-Potential Signals , 2004 .

[50]  Nilanjan Sarkar,et al.  Physiology-based Affect Recognition During Driving in Virtual Environment for Autism Intervention , 2015, PhyCS.

[51]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[52]  Luiz Affonso Guedes,et al.  Performance evaluation of a compression algorithm for wireless sensor networks in monitoring applications , 2008, 2008 IEEE International Conference on Emerging Technologies and Factory Automation.

[53]  Mahmut Ozer,et al.  EEG signals classification using the K-means clustering and a multilayer perceptron neural network model , 2011, Expert Syst. Appl..

[54]  Mika P. Tarvainen,et al.  Kubios HRV - Heart rate variability analysis software , 2014, Comput. Methods Programs Biomed..

[55]  T. Subba Rao,et al.  Classification, Parameter Estimation and State Estimation: An Engineering Approach Using MATLAB , 2004 .

[56]  Peter R. Kinget,et al.  A programmable analog cellular neural network CMOS chip for high speed image processing , 1995, IEEE J. Solid State Circuits.

[57]  Antonello Monti,et al.  Fault Detection and Classification in Medium Voltage DC Shipboard Power Systems With Wavelets and Artificial Neural Networks , 2014, IEEE Transactions on Instrumentation and Measurement.

[58]  Haruki Kawanaka,et al.  Driver's cognitive distraction detection using physiological features by the adaboost , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[59]  U. Rajendra Acharya,et al.  One-Class Classification of Mammograms Using Trace Transform Functionals , 2014, IEEE Transactions on Instrumentation and Measurement.

[60]  John D Lee,et al.  Combining cognitive and visual distraction: less than the sum of its parts. , 2010, Accident; analysis and prevention.

[61]  Georg Brasseur Design rules for robust capacitive sensors , 2003, IEEE Trans. Instrum. Meas..

[62]  Leon O. Chua,et al.  Cellular neural networks: applications , 1988 .

[63]  Péter Szolgay,et al.  Configurable multilayer CNN-UM emulator on FPGA , 2003 .