A Probabilistic Model for Surveillance Video Mining

With the vast use of video surveillance systems, there are more and more video data. An exciting field called video mining is now putting forward which focuses on extracting semantic info, implicit patterns and knowledge from video data. In this paper, a surveillance video data mining approach is proposed to discover similar video segments from surveillance video through a probabilistic model. First, a simple background subtraction algorithm is utilized to get the binary mask of moving objects. So the motion of every frame is calculated to segment the sequence of surveillance video. Then a mixture of hidden Markov models using the expectation-maximization scheme is fitted to the motion data with some probability to identity the similar segments. Finally, abnormal events and meaningful patterns are mined. Experiments with real-time video demonstrate the promising potential of this approach

[1]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Michael C. Burl,et al.  Mining Patters of Activity from Video Data , 2004, SDM.

[3]  Jorma Rissanen,et al.  Hypothesis Selection and Testing by the MDL Principle , 1999, Comput. J..

[4]  Jung-Hwan Oh,et al.  Real Time Video Data Mining for Surveillance Video Streams , 2003, PAKDD.

[5]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[6]  Christoph Bregler,et al.  Learning and recognizing human dynamics in video sequences , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Osmar R. Zaïane,et al.  Application of Data Mining Techniques for Medical Image Classification , 2001, MDM/KDD.

[8]  Jun Zhang,et al.  Video mining: concepts, approaches and applications , 2006, 2006 12th International Multi-Media Modelling Conference.

[9]  Duminda Wijesekera,et al.  Mining Cinematic Knowledge Work in Progress [An Extended Abstract] , 2000, MDM/KDD.

[10]  Yishay Mansour,et al.  An Information-Theoretic Analysis of Hard and Soft Assignment Methods for Clustering , 1997, UAI.

[11]  Regunathan Radhakrishnan,et al.  Video mining using combinations of unsupervised and supervised learning techniques , 2003, IS&T/SPIE Electronic Imaging.

[12]  Lihi Zelnik-Manor,et al.  Event-based analysis of video , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[14]  Gautam Biswas,et al.  A Bayesian Approach to Temporal Data Clustering using Hidden Markov Models , 2000, ICML.