A novel haptic jacket based alerting scheme in a driver fatigue monitoring system

Sleep deprivation while driving is one of the major cause for roadway accidents. Eye closure and blink frequency are two of the primary evidences of driver fatigue. In this paper we propose a non-obtrusive driver alerting scheme, where we monitor the operator's eye closure and blink parameters in real-time. Our developed system delivered an accuracy rate of 96% in eye states recognition that we leverage to deduce multi-level driver drowsiness states. Based on the level of fatigues we setup haptic altering scheme by using our previously developed haptic jacket. We consider an online progressive haptic alerting scheme (similar to silent mobile vibration alert) to warn the drowsy operator in order to prevent major road accidents. We propose a preliminary prototype of the system and evaluate its suitability in a controlled in lab usability study.

[1]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Alan L. Yuille,et al.  Feature extraction from faces using deformable templates , 2004, International Journal of Computer Vision.

[3]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[4]  James J. Staszewski,et al.  The Carnegie Mellon TruckSim: a tool to improve driving safety , 1998, 17th DASC. AIAA/IEEE/SAE. Digital Avionics Systems Conference. Proceedings (Cat. No.98CH36267).

[5]  Takeo Kanade,et al.  Eye-State Action Unit Detection by Gabor Wavelets , 2000, ICMI.

[6]  Riad I. Hammoud,et al.  Alertometer: Detecting and Mitigating Driver Drowsiness and Fatigue Using an Integrated Human Factors and Computer Vision Approach , 2008 .

[7]  Ying Zilu,et al.  Combining LBP and Adaboost for facial expression recognition , 2008, 2008 9th International Conference on Signal Processing.

[8]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[9]  Zhiwei Zhu,et al.  Real-time eye detection and tracking under various light conditions , 2002, ETRA.

[10]  D. Dinges,et al.  EVALUATION OF TECHNIQUES FOR OCULAR MEASUREMENT AS AN INDEX OF FATIGUE AND THE BASIS FOR ALERTNESS MANAGEMENT , 1998 .

[11]  David F. Dinges,et al.  Perclos: A valid psychophysiological measure of alertness as assessed by psychomotor vigilance , 1998 .

[12]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[13]  R Subramanian,et al.  Factors Related to Fatal Single-Vehicle Run-Off-Road Crashes , 2009 .

[14]  Shaogang Gong,et al.  Robust facial expression recognition using local binary patterns , 2005, IEEE International Conference on Image Processing 2005.

[15]  Ward Vanlaar,et al.  Fatigued and drowsy driving: a survey of attitudes, opinions and behaviors. , 2008, Journal of safety research.

[16]  Abdulmotaleb El Saddik,et al.  Interpersonal haptic communication in second life , 2010, 2010 IEEE International Symposium on Haptic Audio Visual Environments and Games.

[17]  R. Likert “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[18]  Abu Saleh Md. Mahfujur Rahman,et al.  LBP-based driver fatigue monitoring system with the adoption of haptic warning scheme , 2011, 2011 IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems Proceedings.

[19]  Xiao Fan,et al.  Nonintrusive Driver Fatigue Detection , 2008, 2008 IEEE International Conference on Networking, Sensing and Control.