Abandoned object detection using operator-space pursuit

This work presents a framework to be used in the detection of abandoned objects and other video events in a cluttered environment with a moving camera. In the proposed method a target video, that may have features we would like to detect, is compared with a pre-acquired reference video, which is assumed to have no objects nor video events of interest. The comparison is carried out by way of the achieved optimized operators, generated from the reference video, that produce Gaussian outputs when applied to it. Any anomaly of interest in the target video leads to a non-Gaussian output. The method dispenses with the target and reference videos being either synchronized or precisely registered, being robust to rotations and translations between the frames. Experiments show its good performance in the proposed environment.

[1]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[2]  Hironobu Fujiyoshi,et al.  Moving target classification and tracking from real-time video , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[3]  Steven S. Beauchemin,et al.  The computation of optical flow , 1995, CSUR.

[4]  Gustavo Carvalho,et al.  An annotated video database for abandoned-object detection in a cluttered environment , 2014, 2014 International Telecommunications Symposium (ITS).

[5]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[6]  Joan Serrat,et al.  Alignment of videos recorded from moving vehicles , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[7]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Hamid Krim,et al.  Optimal Operator Space Pursuit: A Framework for Video Sequence Data Analysis , 2012, ACCV.

[9]  Hai Quang Dam,et al.  Deleted DOI: Postfiltering Using Multichannel Spectral Estimation in Multispeaker Environments , 2008 .

[10]  Xiao Bian.  Video-based Human Activity Analysis : An Operator-based Approach , 2012 .

[11]  Dale Schuurmans,et al.  Real-Time Discriminative Background Subtraction , 2011, IEEE Transactions on Image Processing.

[12]  Rogério Schmidt Feris,et al.  Robust Detection of Abandoned and Removed Objects in Complex Surveillance Videos , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[13]  Eduardo A. B. da Silva,et al.  On the detection of abandoned objects with a moving camera using robust subspace recovery and sparse representation , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Venkatesh Saligrama,et al.  Video Anomaly Identification , 2010, IEEE Signal Processing Magazine.

[15]  Hainan Zhang.  Topology of fiber bundles , 2014 .

[16]  Jan-Olof Eklundh,et al.  Statistical background subtraction for a mobile observer , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[17]  Ashish Ghosh,et al.  A Change Information Based Fast Algorithm for Video Object Detection and Tracking , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[20]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[21]  Ronald N. Bracewell,et al.  The Fourier Transform and Its Applications , 1966 .

[22]  Jean Ponce,et al.  Detecting Abandoned Objects With a Moving Camera , 2010, IEEE Transactions on Image Processing.

[23]  Egor Tsinko,et al.  Background subtraction with a pan/tilt camera , 2010 .

[24]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[25]  Yuri Ivanov,et al.  Robust Abandoned Object Detection Using Dual Foregrounds , 2008, EURASIP J. Adv. Signal Process..

[26]  Christian Bauckhage,et al.  Efficient and Robust Alignment of Unsynchronized Video Sequences , 2011, DAGM-Symposium.

[27]  Q. M. Jonathan Wu,et al.  Multiresolution Based Gaussian Mixture Model for Background Suppression , 2013, IEEE Transactions on Image Processing.

[28]  Joan Serrat,et al.  Video Alignment for Change Detection , 2011, IEEE Transactions on Image Processing.

[29]  B. Choudhary.  The elements of complex analysis , 1983 .

[30]  Venkatesh Saligrama,et al.  Behavior Subtraction , 2012, IEEE Transactions on Image Processing.

[31]  A.K. Krishnamurthy,et al.  Multidimensional digital signal processing , 1985, Proceedings of the IEEE.

[32]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[33]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[34]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[35]  Carlo S. Regazzoni,et al.  Bayesian Tracking for Video Analytics , 2010, IEEE Signal Processing Magazine.

[36]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[37]  Hamid Krim,et al.  Robust Subspace Recovery via Dual Sparsity Pursuit , 2014, ArXiv.

[38]  Mubarak Shah,et al.  Detection of Independently Moving Objects in Non-planar Scenes via Multi-Frame Monocular Epipolar Constraint , 2012, ECCV.