Intelligent Driver Monitoring Based on Physiological Sensor Signals: Application Using Camera

Recently, there has been increasing interest in low-cost, non-contact and pervasive methods for monitoring physiological information for the drivers. For the intelligent driver monitoring system there has been so many approaches like facial expression based method, driving behavior based method and physiological parameters based method. Physiological parameters such as, heart rate (HR), heart rate variability (HRV), respiration rate (RR) etc. are mainly used to monitor physical and mental state. Also, in recent decades, there has been increasing interest in low-cost, non-contact and pervasive methods for measuring physiological information. Monitoring physiological parameters based on camera images is such kind of expected methods that could offer a new paradigm for driver's health monitoring. In this paper, we review the latest developments in using camera images for non-contact physiological parameters that provides a resource for researchers and developers working in the area.

[1]  L. O. Svaasand,et al.  Remote plethysmographic imaging using ambient light. , 2008, Optics express.

[2]  Ioannis T. Pavlidis,et al.  Thermistor at a Distance: Unobtrusive Measurement of Breathing , 2010, IEEE Transactions on Biomedical Engineering.

[3]  Yue Tian,et al.  Contact-free Measurement of Heart Rate Variability via a Microwave Sensor , 2009, Sensors.

[4]  T. Ward,et al.  Noncontact simultaneous dual wavelength photoplethysmography: a further step toward noncontact pulse oximetry. , 2007, The Review of scientific instruments.

[5]  Shaibal Barua,et al.  EEG sensor based classification for assessing psychological stress. , 2013, Studies in health technology and informatics.

[6]  Yuan-Hsiang Lin,et al.  A Driver's Physiological Monitoring System Based on a Wearable PPG Sensor and a Smartphone , 2011, SUComS.

[7]  M. Grigioni,et al.  Optical Vibrocardiography: A Novel Tool for the Optical Monitoring of Cardiac Activity , 2006, Annals of Biomedical Engineering.

[8]  Mobyen Uddin Ahmed,et al.  Physiological Sensor Signals Classification for Healthcare Using Sensor Data Fusion and Case-Based Reasoning , 2014, Sensors.

[9]  Y.C. Chen,et al.  Monitoring Driver's Alertness Based on the Driving Performance Estimation and the EEG Power Spectrum Analysis , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[10]  Westgate Road,et al.  Photoplethysmography and its application in clinical physiological measurement , 2007 .

[11]  Tülay Adali,et al.  Joint Blind Source Separation With Multivariate Gaussian Model: Algorithms and Performance Analysis , 2012, IEEE Transactions on Signal Processing.

[12]  Yadong Wang,et al.  A review of non-contact, low-cost physiological information measurement based on photoplethysmographic imaging , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  Shahina Begum,et al.  Intelligent driver monitoring systems based on physiological sensor signals: A review , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[14]  German Da Costa,et al.  Optical remote sensing of heartbeats , 1995 .

[15]  Zhiqi Shen,et al.  Physiological parameter monitoring of drivers based on video data and independent vector analysis , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Mobyen Uddin Ahmed,et al.  Mental state monitoring system for the professional drivers based on Heart Rate Variability analysis and Case-Based Reasoning , 2012, 2012 Federated Conference on Computer Science and Information Systems (FedCSIS).

[17]  Ming Wang,et al.  Webcam based non-contact real-time monitoring for the physiological parameters of drivers , 2014, The 4th Annual IEEE International Conference on Cyber Technology in Automation, Control and Intelligent.

[18]  Mobyen Uddin Ahmed,et al.  K-NN based interpolation to handle artifacts for heart rate variability analysis , 2011, 2011 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[19]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[20]  H.T. Nguyen,et al.  Early Driver Fatigue Detection from Electroencephalography Signals using Artificial Neural Networks , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[21]  Masayuki Ishihara,et al.  Development of Non-contact Monitoring System of Heart Rate Variability (HRV) - An Approach of Remote Sensing for Ubiquitous Technology - , 2009, HCI.

[22]  Jeen-Shing Wang,et al.  Driving Conditions Recognition Using Heart Rate Variability Indexes , 2010, 2010 Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[23]  Janko Drnovsek,et al.  Non-contact heart rate and heart rate variability measurements: A review , 2014, Biomed. Signal Process. Control..

[24]  Valery V. Tuchin,et al.  Pulse-wave monitoring by means of focused laser beams scattered by skin surface and membranes , 1993, Photonics West - Lasers and Applications in Science and Engineering.

[25]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[26]  Agnar Aamodt,et al.  CASE-BASED REASONING: FOUNDATIONAL ISSUES, METHODOLOGICAL VARIATIONS, AND SYSTEM APPROACHES AICOM - ARTIFICIAL INTELLIGENCE COMMUNICATIONS , 1994 .

[27]  Kwang Suk Park,et al.  Nonintrusive Biosignal Measurement System in a Vehicle , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[28]  A. Malliani,et al.  Heart rate variability. Standards of measurement, physiological interpretation, and clinical use , 1996 .

[29]  Shaibal Barua,et al.  A Review on Machine Learning Algorithms in Handling EEG Artifacts , 2014 .

[30]  Maria E. Jabon,et al.  Facial expression analysis for predicting unsafe driving behavior , 2011, IEEE Pervasive Computing.

[31]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[32]  W. Zijlstra,et al.  Absorption spectra of human fetal and adult oxyhemoglobin, de-oxyhemoglobin, carboxyhemoglobin, and methemoglobin. , 1991, Clinical chemistry.

[33]  A. Kandaswamy,et al.  Removal of Ocular Artifacts from EEG—A Survey , 2005 .

[34]  D.I. Fotiadis,et al.  A reasoning-based framework for car driver’s stress prediction , 2008, 2008 16th Mediterranean Conference on Control and Automation.

[35]  Liu Xiaoming,et al.  Data Preprocessing Method of ECG Indicators When Applied ECG in Driver Mental Workload Research , 2009, 2009 Second International Conference on Intelligent Computation Technology and Automation.

[36]  Deva Ramanan,et al.  Face detection, pose estimation, and landmark localization in the wild , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Riza Atiq Abdullah O.K. Rahmat,et al.  Intelligent transport system for motorcycle safety and issues , 2009 .

[38]  C. Takano,et al.  Heart rate measurement based on a time-lapse image. , 2007, Medical engineering & physics.

[39]  Madalena Costa,et al.  Multiscale entropy analysis of complex physiologic time series. , 2002, Physical review letters.

[40]  M Bergomi,et al.  Biological and behavioral factors affecting driving safety. , 2006, Journal of preventive medicine and hygiene.

[41]  Marc Garbey,et al.  Contact-Free Measurement of Cardiac Pulse Based on the Analysis of Thermal Imagery , 2007, IEEE Transactions on Biomedical Engineering.

[42]  Murielle Kirkove,et al.  Comparative evaluation of existing and new methods for correcting ocular artifacts in electroencephalographic recordings , 2014, Signal Process..

[43]  Agnar Aamodt,et al.  Case-Based Reasoning: Foundational Issues, Methodological Variations, and System Approaches , 1994, AI Commun..

[44]  Rosalind W. Picard,et al.  Non-contact, automated cardiac pulse measurements using video imaging and blind source separation , 2022 .

[45]  E. F. Greneker,et al.  Radar sensing of heartbeat and respiration at a distance with applications of the technology , 1997 .

[46]  R. Ward,et al.  EMG and EOG artifacts in brain computer interface systems: A survey , 2007, Clinical Neurophysiology.

[47]  Mobyen Uddin Ahmed,et al.  Classification of physiological signals for wheel loader operators using Multi-scale Entropy analysis and case-based reasoning , 2014, Expert Syst. Appl..

[48]  Y. Mendelson.  Pulse oximetry: theory and applications for noninvasive monitoring. , 1992, Clinical chemistry.

[49]  Ki H. Chon,et al.  Physiological Parameter Monitoring from Optical Recordings With a Mobile Phone , 2012, IEEE Transactions on Biomedical Engineering.

[50]  Janet L. Kolodner,et al.  Reconstructive Memory: A Computer Model , 1983, Cogn. Sci..