A review on driver drowsiness based on image, bio-signal, and driver behavior

The ratio of accidents caused by drowsiness, increases slightly year by year. The most victims of this case are young adult and mostly happens in developed country. Therefore, to reduce the number of accidents caused by drowsiness, researchers around the world develope some methods for detecting drowsiness on driver's face automatically. They propose various features such as visual, non-visual, and vehicular. Visual features are extracted from driver's face and recorded by camera. Non-visual features are signals emerged from driver's body and to acquire those signals, they use special sensor attached to driver's body. Vehicular features are obtained by observing the behavior of driver during driving. From those features which are propsed by researchers, we discussed 3 ideas that can be considered as guidance to lead researcher in developing drowsiness detection. The first idea is creating the dataset of drowsiness facial expression because it can predict drowsiness and fatigue. Second idea is to combine visual, non-visual, and vehicular features into one for better detection. And last one is developing wearable hardwares such as smartwatch for drowsiness detection which are easy to use and user friendly.

[1]  Mona Omidyeganeh,et al.  Intelligent driver drowsiness detection through fusion of yawning and eye closure , 2011, 2011 IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems Proceedings.

[2]  Kai-Wei Ke,et al.  Drowsiness Detection System Using Heartbeat Rate in Android-Based Handheld Devices , 2016, 2016 First International Conference on Multimedia and Image Processing (ICMIP).

[3]  Mohammad Rahmati,et al.  Driver drowsiness detection using face expression recognition , 2011, 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA).

[4]  Behnoosh Hariri,et al.  YawDD: a yawning detection dataset , 2014, MMSys '14.

[5]  Paul Russel B. Agustin,et al.  MATLAB based drowsiness detection system using an array of sensors and fuzzy logic , 2014, TENCON 2014 - 2014 IEEE Region 10 Conference.

[6]  Wan-Young Chung,et al.  Driver Alertness Monitoring Using Fusion of Facial Features and Bio-Signals , 2012, IEEE Sensors Journal.

[7]  Hang-Bong Kang,et al.  Various Approaches for Driver and Driving Behavior Monitoring: A Review , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[8]  Miyoung Kim,et al.  Driver drowsiness detection using the in-ear EEG , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[9]  Weihua Sheng,et al.  An integrated manual and autonomous driving framework based on driver drowsiness detection , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  R. A. Zoroofi,et al.  A new system for driver drowsiness and distraction detection , 2012, 20th Iranian Conference on Electrical Engineering (ICEE2012).

[11]  Micheal Drieberg,et al.  Driver drowsiness detection using EEG power spectrum analysis , 2014, 2014 IEEE REGION 10 SYMPOSIUM.

[12]  Hong Zhao,et al.  Real Time Drowsiness Detection Based on Lateral Distance Using Wavelet Transform and Neural Network , 2015, 2015 IEEE Symposium Series on Computational Intelligence.

[13]  Siew Wen Chin,et al.  A mobile driver safety system: Analysis of single-channel EEG on drowsiness detection , 2014, 2014 International Conference on Computational Science and Technology (ICCST).

[14]  In-Ho Choi,et al.  Head pose and gaze direction tracking for detecting a drowsy driver , 2014, 2014 International Conference on Big Data and Smart Computing (BIGCOMP).

[15]  Wan-Young Chung,et al.  Standalone Wearable Driver Drowsiness Detection System in a Smartwatch , 2016, IEEE Sensors Journal.

[16]  Taro Nakamura,et al.  Driver drowsiness estimation from facial expression features computer vision feature investigation using a CG model , 2015, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[17]  Antonio Pardo,et al.  A feasability study of drowsiness detection using driving behaviour parameters , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[18]  Zheren Ma,et al.  Wearable driver drowsiness detection using electrooculography signal , 2016, 2016 IEEE Topical Conference on Wireless Sensors and Sensor Networks (WiSNet).

[19]  Satori Hachisuka,et al.  Human and Vehicle-Driver Drowsiness Detection by Facial Expression , 2013, 2013 International Conference on Biometrics and Kansei Engineering.

[20]  Refet Firat Yazicioglu,et al.  Biopotential Readout Circuits for Portable Acquisition Systems , 2008 .

[21]  Tohru Yagi,et al.  Drowsiness detection by skin potential activity , 2013, The 6th 2013 Biomedical Engineering International Conference.

[22]  Ajay Mittal,et al.  Head movement-based driver drowsiness detection: A review of state-of-art techniques , 2016, 2016 IEEE International Conference on Engineering and Technology (ICETECH).

[23]  Hung T. Nguyen,et al.  EEG-based driver fatigue detection using hybrid deep generic model , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[24]  Gwen Littlewort,et al.  The computer expression recognition toolbox (CERT) , 2011, Face and Gesture 2011.

[25]  Antoine Picot,et al.  On-Line Detection of Drowsiness Using Brain and Visual Information , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[26]  Yang Wang,et al.  EEG-Based Real-Time Drowsiness Detection Using Hilbert-Huang Transform , 2015, 2015 7th International Conference on Intelligent Human-Machine Systems and Cybernetics.

[27]  Wan-Young Chung,et al.  Wearable driver drowsiness detection system based on biomedical and motion sensors , 2015, 2015 IEEE SENSORS.

[28]  Xin Liu,et al.  Detection methods for a low-cost accelerometer-based approach for driver drowsiness detection , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[29]  Muhammad Jawad Khan,et al.  Drowsiness detection using fNIRS in different time windows for a passive BCI , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[30]  Ping Wang,et al.  A method of detecting driver drowsiness state based on multi-features of face , 2012, 2012 5th International Congress on Image and Signal Processing.

[31]  Weihua Sheng,et al.  A driver assistance framework based on driver drowsiness detection , 2016, 2016 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER).

[32]  Raúl Quintero,et al.  Drowsiness monitoring based on driver and driving data fusion , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[33]  Gwen Littlewort,et al.  Discrimination of Moderate and Acute Drowsiness Based on Spontaneous Facial Expressions , 2010, 2010 20th International Conference on Pattern Recognition.

[34]  Naokazu Yokoya,et al.  Vehicle Driver Face Detection in Various Sunlight Environments Using Composed Face Images , 2014, 2014 22nd International Conference on Pattern Recognition.

[35]  Amir Jalilifard,et al.  An efficient K-NN approach for automatic drowsiness detection using single-channel EEG recording , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[36]  Abdelaziz Khiat,et al.  Prediction of drowsy driving by monitoring driver's behavior , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[37]  Makoto Itoh,et al.  Driver Assistance System With a Dual Control Scheme: Effectiveness of Identifying Driver Drowsiness and Preventing Lane Departure Accidents , 2016, IEEE Transactions on Human-Machine Systems.

[38]  Patricia Mongelia.  The National Sleep Foundation , 2007 .

[39]  Keum-Shik Hong,et al.  Drowsiness detection in dorsolateral-prefrontal cortex using fNIRS for a passive-BCI , 2015, 2015 15th International Conference on Control, Automation and Systems (ICCAS).

[40]  Yo-Ping Huang,et al.  A two-stage intelligent model to extract features from PPG for drowsiness detection , 2016, 2016 International Conference on System Science and Engineering (ICSSE).

[41]  Taro Nakamura,et al.  Detection of Driver's Drowsy Facial Expression , 2013, 2013 2nd IAPR Asian Conference on Pattern Recognition.

[42]  Kathrin Pollmann,et al.  fNIRS as a Method to Capture the Emotional User Experience: A Feasibility Study , 2016, HCI.

[43]  Yan Yang,et al.  Driver Drowsiness Detection Based on Novel Eye Openness Recognition Method and Unsupervised Feature Learning , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.