Yawning Recognition based on Dynamic Analysis and Simple Measure

Nowadays drivers fatigue is amongst significant causes of traffic accidents. There exist many academic and industrial publications, where fatigue detection is presented. Yawning is one of the most detectable and indicative symptoms in such situation. However, yawning identification approaches which have been developed to date are limited by the fact that they detect a wide open mouth. And the detection of open mouth can also mean talking, singing and smiling, what is not always a sign of fatigue. The research aims was to investigate the different situations when the mouth is open and distinguish situation when really yawning occurred. In this paper we use an algorithm for localization of the facial landmarks and we propose a simple and effective system for yawning detection which is based on changes of mouth geometric features. The accuracy of presented method was verified using 80 videos collected from three databases: we have used 20 films of yawning expression, 30 films of smiling and 30 films with singing examples. The experimental results show high accuracy of proposed method on the level of 93%. The obtained results have been compared with the methods described in the literature – the achieved accuracy puts proposed method among the best solutions of recent years.

[1]  Albert Ali Salah,et al.  Are You Really Smiling at Me? Spontaneous versus Posed Enjoyment Smiles , 2012, ECCV.

[2]  Prajoy Podder,et al.  Driver Fatigue Recognition using Skin Color Modeling , 2014 .

[3]  Bin Yang,et al.  Camera-based drowsiness reference for driver state classification under real driving conditions , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[4]  Dariusz Sawicki,et al.  Facial landmarks localization using binary pattern analysis , 2016 .

[5]  Behnoosh Hariri,et al.  A yawning measurement method using embedded smart cameras , 2013, 2013 IEEE International Instrumentation and Measurement Technology Conference (I2MTC).

[6]  Dariusz J. Sawicki,et al.  Recognition of the Human Fatigue Based on the ICAAM Algorithm , 2015, ICIAP.

[7]  Dr. N. C. Barwar,et al.  Detection of Eye Blinking and Yawning for Monitoring Driver ’ s Drowsiness in Real Time , 2014 .

[8]  Aouatif Amine,et al.  Driver's fatigue detection based on yawning extraction , 2014 .

[9]  John J. Soraghan,et al.  Yawn analysis with mouth occlusion detection , 2015, Biomed. Signal Process. Control..

[10]  Muhammad Reza Pourshahabi,et al.  A Review on Driver Face Monitoring Systems for Fatigue and Distraction Detection , 2014 .

[11]  Zhenlong Li,et al.  Yawning detection for monitoring driver fatigue based on two cameras , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[12]  Anwar M. Mirza,et al.  Automatic Fatigue Detection of Drivers through Yawning Analysis , 2009, FGIT-SIP.

[13]  S. Padma Rubhan,et al.  Driver Fatigue Detection Based On Eye Track: A Survey , 2014 .

[14]  Pengfei Shi,et al.  Yawning detection for determining driver drowsiness , 2005, Proceedings of 2005 IEEE International Workshop on VLSI Design and Video Technology, 2005..

[15]  B. N. Manu,et al.  Facial features monitoring for real time drowsiness detection , 2016, 2016 12th International Conference on Innovations in Information Technology (IIT).

[16]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  I.L.D. Houtman,et al.  OSH in Figures: Occupational Safety and Health in the Transport Sector - An Overview , 2011 .