Unsupervised detection of nonlinearity in motion using weighted average of non-extensive entropies

Motion estimation and motion analysis have an important role to play for detecting abnormal motion in surveillance videos. In this paper, we propose to use the non-extensive entropy to detect any unnaturalness in the motion over correlated video frames since it has already been proved to represent the correlated textures successfully. To achieve this end, we utilize the temporal correlation property of motion vectors over three consecutive frames to detect any motion disturbance using a weighted average of the non-extensive entropies. It is proved by the experimental results on the state-of-the-art database that the non-extensive entropy is most apt for detecting any disturbance in the continuance of motion vectors in between frames. The advantage of our approach is that no training period or normalcy reference is required since a relative disturbance in the magnitudes of motion vectors over a three-frame window gives an alarm.

[1]  Yao Wang,et al.  Video Processing and Communications , 2001 .

[2]  HongJiang Zhang,et al.  A new perceived motion based shot content representation , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[3]  Madasu Hanmandlu,et al.  A non-extensive entropy feature and its application to texture classification , 2013, Neurocomputing.

[4]  Mubarak Shah,et al.  Floor Fields for Tracking in High Density Crowd Scenes , 2008, ECCV.

[5]  Márcio Portes de Albuquerque,et al.  Image thresholding using Tsallis entropy , 2004, Pattern Recognit. Lett..

[6]  Yu Hen Hu,et al.  Motion Entropy Feature and Its Applications to Event-Based Segmentation of Sports Video , 2008, EURASIP J. Adv. Signal Process..

[7]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[8]  Junsong Yuan,et al.  Sparse reconstruction cost for abnormal event detection , 2011, CVPR 2011.

[9]  A. Rényi On Measures of Entropy and Information , 1961 .

[10]  Ramin Mehran,et al.  Abnormal crowd behavior detection using social force model , 2009, CVPR.

[11]  Yinghuan Shi,et al.  Real-Time Abnormal Event Detection in Complicated Scenes , 2010, 2010 20th International Conference on Pattern Recognition.

[12]  W. Eric L. Grimson,et al.  Unsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Jiri Matas,et al.  P-N learning: Bootstrapping binary classifiers by structural constraints , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Sankar K. Pal,et al.  Entropy: a new definition and its applications , 1991, IEEE Trans. Syst. Man Cybern..

[15]  Alessio Del Bue,et al.  Optimizing interaction force for global anomaly detection in crowded scenes , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[16]  Ming-Hsuan Yang,et al.  Visual tracking with online Multiple Instance Learning , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Shaogang Gong,et al.  Video Behavior Profiling for Anomaly Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Ying Wu,et al.  Scribble Tracker: A Matting-Based Approach for Robust Tracking , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Andrew Zisserman,et al.  A Statistical Approach to Texture Classification from Single Images , 2005, International Journal of Computer Vision.

[20]  Tianming Liu,et al.  A novel video key-frame-extraction algorithm based on perceived motion energy model , 2003, IEEE Trans. Circuits Syst. Video Technol..