Reliability of motion features in surveillance videos

Although a tremendous effort has been made to perform a reliable analysis of images and videos in the past fifty years, the reality is that one cannot rely 100% on the analysis results. With exception of applications in controlled environments (e.g., machine vision application), one has to deal with an open world, which means that content of images may significantly change, and it seems impossible to predict all possible changes. Relying on content-based video analysis may lead to bogus results, since the observed changes may be consequence of unreliable features, and not necessarily of observed events of interest. Our main strategy is to estimate the feature properties when the features are reliable computed, so that any set of features that does not have these properties is detected as being unreliable. This way we do not perform any direct content analysis, but instead perform unsupervised analysis of feature properties that are related to the reliability. The solution pursuit in this paper is to monitor the reliability of the computed features using temporal changes and statistical properties of feature value distributions. Results on benchmark real-life videos demonstrate the capability of the proposed techniques to successfully eliminate problems due to change in light conditions, transition/compression artifacts and unwanted camera motions.

[1]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[2]  Dragoljub Pokrajac.  ENTROPY-BASED APPROACH FOR DETECTING FEATURE RELIABILITY , 2004 .

[3]  Yongmin Li,et al.  On incremental and robust subspace learning , 2004, Pattern Recognit..

[4]  Mubarak Shah,et al.  A hierarchical approach to robust background subtraction using color and gradient information , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[5]  Borko Furht,et al.  Real-time video compression - techniques and algorithms , 1997, The Kluwer international series in engineering and computer science.

[6]  Bernard D. Flury,et al.  Why Multivariate Statistics , 1997 .

[7]  Dragoljub Pokrajac,et al.  Motion Detection Based on Local Variation of Spatiotemporal Texture , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[8]  Sridha Sridharan,et al.  Real-time adaptive background segmentation , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[9]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Ramesh C. Jain,et al.  Separating Non-Stationary from Stationary Scene Components in a Sequence of Real World TV Images , 1977, IJCAI.

[11]  Lennart Ljung,et al.  Theory and Practice of Recursive Identification , 1983 .

[12]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[13]  Shaogang Gong,et al.  Object Tracking Using Adaptive Color Mixture Models , 1998, ACCV.

[14]  Aapo Hyvärinen,et al.  New Approximations of Differential Entropy for Independent Component Analysis and Projection Pursuit , 1997, NIPS.

[15]  J. Cooley,et al.  The Fast Fourier Transform , 1975 .

[16]  Juyang Weng,et al.  Candid Covariance-Free Incremental Principal Component Analysis , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Ralph R. Martin,et al.  Incremental Eigenanalysis for Classification , 1998, BMVC.

[18]  David G. Stork,et al.  Pattern Classification , 1973 .

[19]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  José Santos-Victor,et al.  Performance Evaluation of Incremental Eigenspace Models for Mobile Robot Localization , 2003 .

[21]  Eric R. Ziegel,et al.  Probability and Statistics for Engineering and the Sciences , 2004, Technometrics.

[22]  Shaoning Pang,et al.  A Modified Incremental Principal Component Analysis for On-Line Learning of Feature Space and Classifier , 2004, PRICAI.

[23]  Takeo Kanade,et al.  Introduction to the Special Section on Video Surveillance , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Ales Leonardis,et al.  Incremental PCA for on-line visual learning and recognition , 2002, Object recognition supported by user interaction for service robots.

[25]  Nikos Paragios,et al.  Video-Based Surveillance Systems , 2002, Springer US.

[26]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Sridha Sridharan,et al.  Real-time adaptive background segmentation , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[28]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[29]  N. Paragios,et al.  Video-Based Surveillance Systems: Computer Vision and Distributed Processing , 2001 .

[30]  Khalid Ali,et al.  Proof , 2006, BMJ : British Medical Journal.

[31]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[32]  Jonathan D. Cryer,et al.  Time Series Analysis , 1986 .

[33]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.