Dynamic obstacle identification based on global and local features for a driver assistance system

This paper proposes a novel dynamic obstacle recognition system combining global feature with local feature to identify vehicles, pedestrians and unknown backgrounds for a driver assistance system. The proposed system consists of two main procedures: a dynamic obstacle detection model to localize an area containing a moving obstacle, and an obstacle identification model, which is a hybrid of global and local information, for recognizing an obstacle with and without occlusion. A dynamic saliency map is used for localizing an area containing a moving obstacle. For the global feature analysis, we propose a modified GIST using orientation features with MAX pooling, which is robust to translation and size variations of an object. Although the global features are a compact way to represent an object and provide a good accuracy for non-occluded objects, they are sensitive to image translation and occlusion. Thus, a local feature-based identification model is also proposed and combined with the global feature. As such, for the obstacle identification problem, the proposed system mainly follows the global feature-based object identification. If the global feature-based model identifies a candidate area as background, the system verifies the area again using the local feature-based model. As a result, the proposed system is able to provide information on both the appearance of obstacles and the class of an obstacle. Experimental results show that the proposed model can successfully detect obstacle candidates and robustly identify obstacles with and without occlusion.

[1]  Reinhold Behringer,et al.  The seeing passenger car 'VaMoRs-P' , 1994, Proceedings of the Intelligent Vehicles '94 Symposium.

[2]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[3]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[4]  Minho Lee,et al.  Biologically motivated vergence control system using human-like selective attention model , 2006, Neurocomputing.

[5]  Kunihiko Fukushima,et al.  Use of non-uniform spatial blur for image comparison: symmetry axis extraction , 2005, Neural Networks.

[6]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[8]  Christian Goerick,et al.  Artificial neural networks in real-time car detection and tracking applications , 1996, Pattern Recognit. Lett..

[9]  Matthew B. Blaschko,et al.  Combining Local and Global Image Features for Object Class Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[10]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[11]  Minho Lee,et al.  Dynamic visual selective attention model , 2008, Neurocomputing.

[12]  Abel G. Oliva,et al.  Gist of a scene , 2005 .

[13]  B. Schiele,et al.  Combined Object Categorization and Segmentation With an Implicit Shape Model , 2004 .

[14]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[15]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[16]  Bruce A. Draper,et al.  Color machine vision for autonomous vehicles , 1998 .

[17]  J. Rodgers,et al.  Thirteen ways to look at the correlation coefficient , 1988 .

[18]  Minho Lee,et al.  Obstacle Categorization Based on Hybridizing Global and Local Features , 2009, ICONIP.

[19]  Bill Fleming Automotive Safety and Convenience Electronics [Automotive Electronics] , 2008, IEEE Vehicular Technology Magazine.

[20]  Thomas Kalinke,et al.  A Texture-based Object Detection and an adaptive Model-based Classification , 1998 .

[21]  Andreas Kuehnle,et al.  Symmetry-based recognition of vehicle rears , 1991, Pattern Recognit. Lett..

[22]  Michael Brady,et al.  Saliency, Scale and Image Description , 2001, International Journal of Computer Vision.

[23]  Minho Lee,et al.  Stereo saliency map considering affective factors and selective motion analysis in a dynamic environment , 2008, Neural Networks.

[24]  Minho Lee,et al.  Saliency map model with adaptive masking based on independent component analysis , 2002, Neurocomputing.

[25]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .