ON THE USE OF SPATIOTEMPORAL VISUAL ATTENTION FOR VIDEO CLASSIFICATION

It is common sense among experts that visual attention plays an important role in perception, being necessary for obtaining salient information about the surroundings. It may be the “glue” that binds simple visual features into an object [1]. Having proposed a spatiotemporal model for visual attention in the past, we elaborate on this work and use it for video classification. Our claim is that simple visual features bound to spatiotemporal salient regions will better represent the video content. Hence, we expect that feature vectors extracted from these regions will enhance the performance of the classifier. We present statistics on sports sequences of five different categories that verify our claims.

[1]  Noboru Babaguchi,et al.  Video clustering using spatio-temporal image with fixed length , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[2]  Qi Tian,et al.  News sports video shot classification with sports play field and motion features , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[3]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[4]  Anil K. Jain,et al.  On image classification: city images vs. landscapes , 1998, Pattern Recognit..

[5]  Qi Tian,et al.  A generic mid-level representation for semantic video analysis , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[6]  Martin Szummer,et al.  Indoor-outdoor image classification , 1998, Proceedings 1998 IEEE International Workshop on Content-Based Access of Image and Video Database.

[7]  Yannis Avrithis,et al.  Spatiotemporal visual attention architecture for video analysis , 2004, IEEE 6th Workshop on Multimedia Signal Processing, 2004..

[8]  Yannis Avrithis,et al.  Handling Uncertainty in Video Analysis with Spatiotemporal Visual Attention , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[9]  Robert M. Gray,et al.  Vector quantization and density estimation , 1997, Proceedings. Compression and Complexity of SEQUENCES 1997 (Cat. No.97TB100171).

[10]  Pavel Pudil,et al.  Introduction to Statistical Pattern Recognition , 2006 .