Real time detection of driver attention: Emerging solutions based on robust iconic classifiers and dictionary of poses

Real time monitoring of driver attention by computer vision techniques is a key issue in the development of advanced driver assistance systems. While past work mostly focused on structured feature-based approaches, characterized by high computational requirements, emerging technologies based on iconic classifiers recently proved to be good candidates for the implementation of accurate and real-time solutions, characterized by simplicity and automatic fast training stages. In this work the combined use of binary classifiers and iconic data reduction, based on Sanger neural networks, is proposed, detailing critical aspects related to the application of this approach to the specific problem of driving assistance. In particular it is investigated the possibility of a simplified learning stage, based on a small dictionary of poses, that makes the system almost independent from the actual user. On-board experiments demonstrate the effectiveness of the approach, even in case of noise and adverse light conditions. Moreover the system proved unexpected robustness to various categories of users, including people with beard and eyeglasses. Temporal integration of classification results, together with a partial distinction among visual distraction and fatigue effects, make the proposed technology an excellent candidate for the exploration of adaptive and user-centered applications in the automotive field. Keywords: Driver distraction;

[1]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[3]  Terence D. Sanger,et al.  Optimal unsupervised learning in a single-layer linear feedforward neural network , 1989, Neural Networks.

[4]  Jesper Sandin,et al.  Vehicle control and drowsiness , 2002 .

[5]  Saman K. Halgamuge,et al.  Comparing two video-based techniques for driver fatigue detection: classification versus optical flow approach , 2011, Machine Vision and Applications.

[6]  Jong-Soo Lee,et al.  Driver’s eye blinking detection using novel color and texture segmentation algorithms , 2012 .

[7]  Robert P. W. Duin,et al.  Dissimilarity-Based Classifications in Eigenspaces , 2011, CIARP.

[8]  Jorge Batista,et al.  A Real-Time Driver Visual Attention Monitoring System , 2005, IbPRIA.

[9]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Enrico Grosso,et al.  Detecting driver inattention by rough iconic classification , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[11]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[12]  John D. Lee,et al.  Real-Time Detection of Driver Cognitive Distraction Using Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[13]  J. Nazuno Haykin, Simon. Neural networks: A comprehensive foundation, Prentice Hall, Inc. Segunda Edición, 1999 , 2000 .

[14]  Elena Lopez,et al.  Visual Monitoring of Driver Inattention , 2008 .

[15]  Nikolaos Papanikolopoulos,et al.  Monitoring driver fatigue using facial analysis techniques , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[16]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Donato Cascio,et al.  Dissimilarity application for medical imaging classification , 2005 .

[18]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[19]  John D. Lee,et al.  A hybrid Bayesian Network approach to detect driver cognitive distraction , 2014 .

[20]  Enrico Grosso,et al.  A driver assistance system based on multilayer iconic classifiers: Model and assessment on adverse conditions , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[21]  Saman K. Halgamuge,et al.  Driver Fatigue Detection by Fusing Multiple Cues , 2007, ISNN.

[22]  Piernicola Oliva,et al.  Automatic cell colony counting by region-growing approach , 2007 .

[23]  Robert P. W. Duin,et al.  Classifiers for dissimilarity-based pattern recognition , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[24]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[25]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .