Classifying Tracked Moving Objects in Outdoor Urban Scenes

Object classification in far-field video sequences is a challenging problem because of low resolution imagery and projective image distortion. We approach the problem by identifying discriminative object features for classifying vehicles and pedestrians in far-field video captured by a static, uncali- brated camera. Using these features, we design a scene-invariant classification system that is trained on a small number of labelled examples from a few scenes. Simultaneously, we demonstrate that use of scene-specific features (such as image position of objects) can greatly improve classification in any given scene. To combine these ideas, we propose an algorithm for adapting a scene-invariant support vector machine object classifier to scene- specific features by retraining with the help of unlabelled data in a novel scene. Experimental results demonstrate the effectiveness of our context features and scene-transfer/adaptation algorithm for multiple urban and highway scenes.

[1]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[2]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[3]  Antonio Torralba,et al.  Statistical Context Priming for Object Detection , 2001, ICCV.

[4]  Daphne Koller,et al.  Toward Optimal Feature Selection , 1996, ICML.

[5]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[6]  Chris Stauffer Minimally-supervised classification using multiple observation sets , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[7]  Nuno Vasconcelos Feature selection by maximum marginal diversity: optimality and implications for visual recognition , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[8]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[9]  David G. Stork,et al.  Pattern Classification , 1973 .

[10]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2005, International Journal of Computer Vision.

[11]  Jitendra Malik,et al.  Fast vehicle detection with probabilistic feature grouping and its application to vehicle tracking , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[12]  Paul A. Viola,et al.  Unsupervised improvement of visual detectors using cotraining , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[13]  Mubarak Shah,et al.  Tracking and Object Classification for Automated Surveillance , 2002, ECCV.

[14]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[16]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[17]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[18]  Tomaso A. Poggio,et al.  Pedestrian detection using wavelet templates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Pat Langley,et al.  Selection of Relevant Features and Examples in Machine Learning , 1997, Artif. Intell..

[20]  Andrzej Sluzek,et al.  Identification and inspection of 2-D objects using new moment-based shape descriptors , 1995, Pattern Recognit. Lett..

[21]  René Dencker Eriksen,et al.  Weighted central moments in pattern recognition , 2000, Pattern Recognit. Lett..

[22]  Biswajit Bose,et al.  Classifying tracked objects in far-field video surveillance , 2004 .

[23]  Hironobu Fujiyoshi,et al.  Moving target classification and tracking from real-time video , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[24]  M. Teague Image analysis via the general theory of moments , 1980 .