A biological cortex like target recognition and tracking in cluttered background

This paper reports how objects in street scenes, such as pedestrians and cars, can be spotted, recognised and then subsequently tracked in cluttered background using a cortex like vision approach. Unlike the conventional pixel based machine vision, tracking is achieved by recognition of the target implemented in neuromorphic ways. In this preliminary study the region of interest (ROI) of the image is spotted according to the salience and relevance of the scene and subsequently target recognition and tracking of the object in the ROI have been performed using a mixture of feed forward cortex like neuromorphic algorithms together with statistical classifier & tracker. Object recognitions for four categories (bike, people, car & background) using only one set of ventral visual like features have achieved a max of ~70% accuracy and the present system is quite effective for tracking prominent objects relatively independent of background types. The extension of the present achievement to improve the recognition accuracy as well as the identification of occluded objects from a crowd formulates the next stage of work.

[1]  B. Schölkopf,et al.  Graph-Based Visual Saliency , 2007 .

[2]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[3]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Ankur Agarwal,et al.  Hyperfeatures - Multilevel Local Coding for Visual Recognition , 2006, ECCV.

[5]  Peter Yuen,et al.  People tracking without prior information: a biological cortex-like neural approach , 2008, Security + Defence.

[6]  Leslie G. Ungerleider Two cortical visual systems , 1982 .

[7]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[8]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[9]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[10]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[11]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[12]  Thomas Serre,et al.  Object recognition with features inspired by visual cortex , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Gary R. Bradski,et al.  Real time face and object tracking as a component of a perceptual user interface , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[14]  David G. Lowe,et al.  University of British Columbia. , 1945, Canadian Medical Association journal.

[15]  Y. LeCun,et al.  Learning methods for generic object recognition with invariance to pose and lighting , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[16]  Allen Allport,et al.  Visual attention , 1989 .