Vision-based Classification of Driving Postures by Efficient Feature Extraction and Bayesian Approach

Reports of traffic accidents show that a considerable percentage of the accidents are caused by human factors. Human-centric driver assistance systems, with integrated sensing, processing and networking, aim to find solutions to this problem and other relevant issues. The key technology in such systems is the capability to automatically understand and characterize driver behaviors. In this paper, we propose a novel, efficient feature extraction approach for driving postures from a video camera, which consists of Homomorphic filter, skin-like regions segmentation, canny edge detection, connected regions detection, small connected regions deletion and spatial scale ratio calculation. With features extracted from a driving posture dataset we created at Southeast University (SEU), holdout and cross-validation experiments on driving posture classification are then conducted using Bayes classifier. Compared with a number of commonly used classification methods including naive Bayes classifier, subspace classifier, linear perception classifier and Parzen classifier, the holdout and cross-validation experiments show that the Bayes classifier offers better classification performance than the other four classifiers. Among the four predefined classes, i.e., grasping the steering wheel, operating the shift gear, eating a cake and talking on a cellular phone, the class of talking on a cellular phone is the most difficult to classify. With Bayes classifier, the classification accuracies of talking on a cellular phone are over 90 % in holdout and cross-validation experiments, which shows the effectiveness of the proposed feature extraction method and the importance of Bayes classifier in automatically understanding and characterizing driver behaviors towards human-centric driver assistance systems.

[1]  Sébastien Marcel,et al.  Lighting Normalization Algorithms for Face Verification , 2005 .

[2]  Nikolaos Papanikolopoulos,et al.  Classifiers for driver activity monitoring , 2007 .

[3]  David G. Stork,et al.  Pattern Classification , 1973 .

[4]  Michael Collins,et al.  Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms , 2002, EMNLP.

[5]  Tzu-Tsung Wong,et al.  Individual attribute prior setting methods for naïve Bayesian classifiers , 2011, Pattern Recognit..

[6]  Chang-Ming Yang,et al.  Vehicle driver's ECG and sitting posture monitoring system , 2009, 2009 9th International Conference on Information Technology and Applications in Biomedicine.

[7]  Bailing Zhang,et al.  Gait Classificaiton in Children with Cerebral Palsy by Bayesian Approach , 2007 .

[8]  Yanchun Zhang,et al.  Gait Classificaiton in Children with Cerebral Palsy by Bayesian Approach , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[9]  Alex Pentland,et al.  Graphical models for driver behavior recognition in a SmartCar , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[10]  Martin A. Kraaijveld,et al.  A Parzen classifier with an improved robustness against deviations between training and test data , 1996, Pattern Recognit. Lett..

[11]  N. Papanikolopoulos,et al.  Driver activity monitoring through supervised and unsupervised learning , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[12]  T. Kato,et al.  Detection of driver's posture in the car by using far infrared camera , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[13]  Kikuo Fujimura,et al.  Real-time pose classification for driver monitoring , 2002, Proceedings. The IEEE 5th International Conference on Intelligent Transportation Systems.

[14]  Tatsuya Suzuki,et al.  Modeling and Recognition of Driving Behavior Based on Stochastic Switched ARX Model , 2007, IEEE Transactions on Intelligent Transportation Systems.

[15]  Paul Watta,et al.  Nonparametric Approaches for Estimating Driver Pose , 2007, IEEE Transactions on Vehicular Technology.

[16]  Sudeep Sarkar,et al.  Comparison of edge detectors: a methodology and initial study , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  David Demirdjian,et al.  Driver pose estimation with 3D Time-of-Flight sensor , 2009, 2009 IEEE Workshop on Computational Intelligence in Vehicles and Vehicular Systems.

[18]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[19]  François Bellavance,et al.  Wireless telephones and the risk of road crashes. , 2003, Accident; analysis and prevention.

[20]  S. Y. Sohn,et al.  Experimental study for the comparison of classifier combination methods , 2007, Pattern Recognit..

[21]  H. Eren,et al.  Stereo Vision and Statistical Based Behaviour Prediction of Driver , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[22]  Mohan M. Trivedi,et al.  Turn-Intent Analysis Using Body Pose for Intelligent Driver Assistance , 2006, IEEE Pervasive Computing.

[23]  Sudeep Sarkar,et al.  Comparison of Edge Detectors: A Methodology and Initial Study , 1998, Comput. Vis. Image Underst..

[24]  Yanchun Zhang,et al.  Classification of cerebral palsy gait by Kernel Fisher Discriminant Analysis , 2008, Int. J. Hybrid Intell. Syst..

[25]  Mohan M. Trivedi,et al.  Vision-Based Infotainment User Determination by Hand Recognition for Driver Assistance , 2010, IEEE Transactions on Intelligent Transportation Systems.

[26]  Mohan M. Trivedi,et al.  Multi-spectral and multi-perspective video arrays for driver body tracking and activity analysis , 2007, Comput. Vis. Image Underst..