The ULg multimodality drowsiness database (called DROZY) and examples of use

Drowsiness is a major cause of accidents, in particular in road transportation. It is thus crucial to develop robust drowsiness monitoring systems. There is a widespread agreement that the best way to monitor drowsiness is by closely monitoring symptoms of drowsiness that are directly linked to the physiology of an operator such as a driver. The best systems are completely transparent to the operator until the moment he/she must react. In transportation, cameras placed in the passenger compartment and looking at least at the face of the driver are most likely the best way to sense physiology related symptoms such as facial expressions and the fine behavior of the eyeballs and eyelids. We present here the new database called DROZY that provides multiple modalities of data to tackle the design of drowsiness monitoring systems and related experiments. We also present two novel systems developed using this database that can make predictions about the speed of reaction of an operator by using near-infrared intensity and range images of his/her face.

[1]  D. Dinges,et al.  Maximizing sensitivity of the psychomotor vigilance test (PVT) to sleep loss. , 2011, Sleep.

[2]  Sylvie Charbonnier,et al.  On-line automatic detection of driver drowsiness using a single electroencephalographic channel , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  R. Schleicher,et al.  Blinks and saccades as indicators of fatigue in sleepiness warners: looking tired? , 2022 .

[4]  A. Buchner,et al.  Drivers' misjudgement of vigilance state during prolonged monotonous daytime driving. , 2009, Accident; analysis and prevention.

[5]  David F. Dinges,et al.  Perclos: A valid psychophysiological measure of alertness as assessed by psychomotor vigilance , 1998 .

[6]  E. Wolpert.  A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Subjects. , 1969 .

[7]  G. Kecklund,et al.  Sleepiness and performance of professional drivers in a truck simulator—comparisons between day and night driving , 1996, Journal of sleep research.

[8]  Murielle Kirkove,et al.  Evaluation of the performance of an experimental somnolence quantification system in terms of reaction times and lapses , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  B. Tefft,et al.  Prevalence of motor vehicle crashes involving drowsy drivers, United States, 1999-2008. , 2012, Accident; analysis and prevention.

[10]  Stuart D Baulk,et al.  Awareness of sleepiness when driving. , 2004, Psychophysiology.

[11]  D. Dinges,et al.  Psychomotor Vigilance Performance: Neurocognitive Assay Sensitive to Sleep Loss , 2004 .

[12]  T. Åkerstedt,et al.  Subjective and objective sleepiness in the active individual. , 1990, The International journal of neuroscience.

[13]  G. Kecklund,et al.  Relations between performance and subjective ratings of sleepiness during a night awake. , 1994, Sleep.

[14]  T. Åkerstedt,et al.  Validation of the Karolinska sleepiness scale against performance and EEG variables , 2006, Clinical Neurophysiology.

[15]  A. W. M. van den Enden,et al.  Discrete Time Signal Processing , 1989 .

[16]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  Andrew Tucker,et al.  Monitoring eye and eyelid movements by infrared reflectance oculography to measure drowsiness in drivers , 2007 .

[18]  Simon Lucey,et al.  Deformable Model Fitting by Regularized Landmark Mean-Shift , 2010, International Journal of Computer Vision.