Review Paper on Yawning Detection Prediction System for Driver Drowsiness

Drowsiness can be dangerous when performing tasks that require constant attention, such as driving a vehicle. Sleepiness is correlated with a variety of physiological variables, such as eye closing, head movements, pulse rate, eye twitch rate, etc. Also, the yawn can be considered as an accurate indicator of drowsiness and fatigue. Yawning detection is very important for the safety purpose of drivers as it will let the driver know if he/she is getting drowsy. Driving at that moment may not be safe. Several automatic yawning detection techniques have been developed for driver's drowsiness monitoring system. Nevertheless, correctly detecting the yawning of the driver and predicting exhaustion in real-time situations is still a crucial challenge. In this paper, we will be reviewing various existing machine learning approaches for driver's yawning detection. In previous approaches, various classical machine learning algorithms such as viola-Jones, contour activation algorithm and SVM have been used for yawning detection, but these approaches failed to predict yawning in realtime situations. Using Deep learning techniques, we can make a real-time yawn detection system with high accuracy. We find that some precious Deep learning algorithms like CNN, RNN, LSTM, Bi-LSTM can detect the patterns with high accuracy. After the comparison of various algorithms and techniques, we find that with the help of Deep learning algorithms the yawning can be detected in real time with high accuracy.

[1]  Zazilah May,et al.  Development of an intelligent drowsiness detection system for drivers using image processing technique , 2020, 2020 IEEE Student Conference on Research and Development (SCOReD).

[2]  Bindhu,et al.  An Enhanced Safety System for Auto Mode E-Vehicles through Mind Wave Feedback , 2020 .

[3]  Ki H. Chon,et al.  Smartphone Based Human Activity Recognition with Feature Selection and Dense Neural Network , 2020, 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC).

[4]  G Ranganathan,et al.  Real Life Human Movement Realization in Multimodal Group Communication Using Depth Map Information and Machine Learning , 2020, Journal of Innovative Image Processing.

[5]  Petchara Inthanon,et al.  Detection of Drowsiness from Facial Images in Real-Time Video Media using Nvidia Jetson Nano , 2020, 2020 17th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON).

[6]  Hiroki Kitajima,et al.  Comprehensive Drowsiness Level Detection Model Combining Multimodal Information , 2020, IEEE Sensors Journal.

[7]  Venkata Phanikrishna B,et al.  Time Domain Parameters as a feature for single-channel EEG-based drowsiness detection method , 2020, 2020 IEEE International Students' Conference on Electrical,Electronics and Computer Science (SCEECS).

[8]  Hitendra Garg,et al.  Drowsiness Detection of a Driver using Conventional Computer Vision Application , 2020, 2020 International Conference on Power Electronics & IoT Applications in Renewable Energy and its Control (PARC).

[9]  M. Durai Pandian,et al.  SLEEP PATTERN ANALYSIS AND IMPROVEMENT USING ARTIFICIAL INTELLIGENCE AND MUSIC THERAPY , 2019, December 2019.

[10]  Shan He,et al.  Research on A Driver Fatigue State Detection System , 2019, 2019 IEEE 13th International Conference on Anti-counterfeiting, Security, and Identification (ASID).

[11]  Dong Liang,et al.  Context-Anchors for Hybrid Resolution Face Detection , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[12]  Yiqiang Chen,et al.  DrowsyDet: A Mobile Application for Real-time Driver Drowsiness Detection , 2019, 2019 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI).

[13]  Varun G. Menon,et al.  A Novel and Efficient Real Time Driver Fatigue and Yawn Detection-Alert System , 2019, 2019 3rd International Conference on Trends in Electronics and Informatics (ICOEI).

[14]  Theekapun Charoenpong,et al.  A Method of Driver’s Eyes Closure and Yawning Detection for Drowsiness Analysis by Infrared Camera , 2019, 2019 First International Symposium on Instrumentation, Control, Artificial Intelligence, and Robotics (ICA-SYMP).

[15]  Deris Stiawan,et al.  Face Movement Detection Using Template Matching , 2018, 2018 International Conference on Electrical Engineering and Computer Science (ICECOS).

[16]  Lei Pang,et al.  F-DR Net:Face detection and recognition in One Net , 2018, 2018 14th IEEE International Conference on Signal Processing (ICSP).

[17]  Shraddha Mane,et al.  Moving Object Detection and Tracking Using Convolutional Neural Networks , 2018, 2018 Second International Conference on Intelligent Computing and Control Systems (ICICCS).

[18]  Weiwei Zhang,et al.  Driver yawning detection based on long short term memory networks , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[19]  Sang Min Yoon,et al.  Human activity recognition from accelerometer data using Convolutional Neural Network , 2017, 2017 IEEE International Conference on Big Data and Smart Computing (BigComp).

[20]  Samra Naz,et al.  Intelligent driver safety system using fatigue detection , 2016, 2017 19th International Conference on Advanced Communication Technology (ICACT).

[21]  P. Shanmugavadivu,et al.  Rapid face detection and annotation with loosely face geometry , 2016, 2016 2nd International Conference on Contemporary Computing and Informatics (IC3I).

[22]  Walid Mahdi,et al.  Yawning detection by the analysis of variational descriptor for monitoring driver drowsiness , 2016, 2016 International Image Processing, Applications and Systems (IPAS).

[23]  Jacob Scharcanski,et al.  Yawning Detection Using Embedded Smart Cameras , 2016, IEEE Transactions on Instrumentation and Measurement.

[24]  Xiaochao Li,et al.  Face Detection Based on Receptive Field Enhanced Multi-Task Cascaded Convolutional Neural Networks , 2020, IEEE Access.

[25]  Shanu Sharma,et al.  Review and comparison of face detection algorithms , 2017, 2017 7th International Conference on Cloud Computing, Data Science & Engineering - Confluence.