Detection and Analysis of Drowsiness in Human Beings Using Multimodal Signals

The state of drowsiness can be characterised as an intermediate state of mind which occurs between the alert state and the sleep state. The alertness of the mind is reflected immediately through the sense organs and other body parts. Automatic detection and analysis of drowsy state of mind is essential in applications where the human’s mental status is important. One such scenario is monitoring driver’s alertness while he is driving. A multi-modal approach is analysed for detecting the drowsy state in humans. Two modalities are considered here, video information and bio signals, for analysis. Visual information conveys a lot about the human alertness. The precise indicators from the video information need to be identified and captured for analysis and detection. The bio signal that indicates human brain alertness is EEG signal. The physical and mental alertness are analysed for detecting drowsiness state of a human being. A framework is proposed for drowsiness detection of humans in real-time.

[1]  A. Chesson,et al.  The American Academy of Sleep Medicine (AASM) Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications , 2007 .

[2]  M. K. Venkatesha,et al.  A Two Fold Expert System for Yawning Detection , 2016 .

[3]  Shervin Shirmohammadi,et al.  Driver drowsiness monitoring based on yawning detection , 2011, 2011 IEEE International Instrumentation and Measurement Technology Conference.

[4]  Gwen Littlewort,et al.  Drowsy Driver Detection Through Facial Movement Analysis , 2007, ICCV-HCI.

[5]  Y. Ichimaru,et al.  Effect of sleep stage on the relationship between respiration and heart rate variability , 1990, [1990] Proceedings Computers in Cardiology.

[6]  G. Moody,et al.  Development of the polysomnographic database on CD‐ROM , 1999, Psychiatry and clinical neurosciences.

[7]  M. Arfan Jaffar,et al.  Automatic Fatigue Detection of Drivers through Pupil Detection and Yawning Analysis , 2009, 2009 Fourth International Conference on Innovative Computing, Information and Control (ICICIC).

[8]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[9]  Xiao Fan,et al.  Yawning Detection for Monitoring Driver Fatigue , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[10]  Richard Grace,et al.  Drowsy Driver Monitor and Warning System , 2017 .

[11]  J A Parker,et al.  Stroke volume and cardiac output decrease at termination of obstructive apneas. , 1992, Journal of applied physiology.

[12]  Dae-Jin Kim,et al.  Detrended fluctuation analysis of EEG in sleep apnea using MIT/BIH polysomnography data , 2002, Comput. Biol. Medicine.

[13]  Behnoosh Hariri,et al.  YawDD: a yawning detection dataset , 2014, MMSys '14.

[14]  Lu Yufeng,et al.  Detecting Driver Yawning in Successive Images , 2007, 2007 1st International Conference on Bioinformatics and Biomedical Engineering.

[15]  Qiang Ji,et al.  Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance , 2002, Real Time Imaging.