Classifiers for driver activity monitoring

The goal of this work is the detection and classification of driver activities in an automobile using computer vision. To this end, this paper presents a novel two-step classification algorithm, namely, an unsupervised clustering algorithm for grouping the actions of a driver during a certain period of time, followed by a supervised activity classification algorithm. The main contribution of this work is the combination of the two methods to provide a computationally fast solution for deployment in real-world scenarios that is robust to illumination and segmentation issues under most conditions experienced in the automobile environment. The unsupervised clustering groups the actions of the driver based on the relative motion detected using a skin-color segmentation algorithm, while the activity classifier is a binary Bayesian eigenimage classifier. Activities are grouped as safe or unsafe and the results of the classification are shown on several subjects obtained from two distinct driving video sequences.

[1]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[2]  James Patrick Williams.  The representation and recovery of axial shape , 1998 .

[3]  Alexander Zelinsky,et al.  Fast Radial Symmetry for Detecting Points of Interest , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  JiQiang,et al.  Real-time eye, gaze, and face pose tracking for monitoring driver vigilance , 2002 .

[5]  Simon Baker.  Real-time non-rigid driver head tracking for driver mental state estimation , 2004 .

[6]  Osama Masoud,et al.  Vision-based methods for driver monitoring , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[7]  Erwin R. Boer,et al.  Toward an Integrated Model of Driver Behavior in Cognitive Architecture , 2001 .

[8]  Alex Pentland,et al.  Graphical models for driver behavior recognition in a SmartCar , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[9]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  James W. Davis,et al.  The Representation and Recognition of Action Using Temporal Templates , 1997, CVPR 1997.

[11]  Zhiwei Zhu,et al.  Real-time eye detection and tracking under various light conditions , 2002, ETRA.

[12]  Zhiwei Zhu,et al.  Real-time nonintrusive monitoring and prediction of driver fatigue , 2004, IEEE Transactions on Vehicular Technology.

[13]  Wang Rongben,et al.  Driver's eye state detecting method design based on eye geometry feature , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[14]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[15]  Yang Song,et al.  Learning probabilistic structure for human motion detection , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[16]  David J. Kriegman,et al.  Recognition using class specific linear projection , 1997 .

[17]  Robert T. Collins,et al.  Articulated Motion Modeling for Activity Analysis , 2004, CVPR 2004.

[18]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Mubarak Shah,et al.  Determining driver visual attention with one camera , 2003, IEEE Trans. Intell. Transp. Syst..

[20]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[21]  I.W. Ricketts,et al.  Towards a non-contact driver-vehicle interface , 2000, ITSC2000. 2000 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.00TH8493).

[22]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[23]  LoyGareth,et al.  Fast Radial Symmetry for Detecting Points of Interest , 2003 .

[24]  Qiang Ji,et al.  Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance , 2002, Real Time Imaging.

[25]  Aaron F. Bobick,et al.  Recognition of Visual Activities and Interactions by Stochastic Parsing , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[27]  Shumeet Baluja,et al.  Non-Intrusive Gaze Tracking Using Artificial Neural Networks , 1993, NIPS.

[28]  Luke Fletcher,et al.  Correlating driver gaze with the road scene for driver assistance systems , 2005, Robotics Auton. Syst..

[29]  Alex Pentland,et al.  Bayesian face recognition , 2000, Pattern Recognit..

[30]  Stephen J. Buckley,et al.  AN AUTOMOBILE-INTEGRATED SYSTEM FOR ASSESSING AND REACTING TO DRIVER COGNITIVE LOAD , 2002 .

[31]  Eric Rodgman,et al.  The role of driver distraction in traffic crashes , 2001 .

[32]  Youding Zhu,et al.  Head pose estimation for driver monitoring , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[33]  Mohan Trivedi,et al.  Driver activity analysis for intelligent vehicles: issues and development framework , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[34]  Vladimir Vezhnevets,et al.  A Survey on Pixel-Based Skin Color Detection Techniques , 2003 .

[35]  R. Tibshirani,et al.  Association between cellular-telephone calls and motor vehicle collisions. , 1997, The New England journal of medicine.

[36]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.