Content-based video sequence interpretation

Video sequence interpretation attempts to make sense of events that occur when they have been captured on video. When such scenario understanding can be employed in real-time or near-instantaneously, it can be applied to situations where constant watch would otherwise be needed. The potential for consumer applications is wide-ranging. Examples include safety monitoring of unattended elderly persons, children, pets and security surveillance. In this paper, we present a content-based video sequence interpretation algorithm for confined or semi-confined spaces. The algorithm comprises spatio-temporal video object (VO) segmentation, feature extraction, and scene analysis. Application of the proposed algorithm is illustrated in the context of security monitoring. Our system activates an alarm to alert the user of a suspicious event virtually instantaneously.

[1]  Sin-Min Tsai,et al.  A service of home security system on intelligent network , 1997 .

[2]  M. Hötter,et al.  Image segmentation based on object oriented mapping parameter estimation , 1988 .

[3]  M. Bierling,et al.  Displacement Estimation By Hierarchical Blockmatching , 1988, Other Conferences.

[4]  R. M. Rodger,et al.  Video motion detection systems: a review for the nineties , 1994, 1994 Proceedings of IEEE International Carnahan Conference on Security Technology.

[5]  King Ngi Ngan,et al.  Video segmentation for content-based coding , 1999, IEEE Trans. Circuits Syst. Video Technol..

[6]  Yo-Sung Ho,et al.  A VOP generation tool: automatic segmentation of moving objects in image sequences based on spatio-temporal information , 1999, IEEE Trans. Circuits Syst. Video Technol..

[7]  Yee-Hong Yang,et al.  First Sight: A Human Body Outline Labeling System , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Laurent Najman,et al.  Geodesic Saliency of Watershed Contours and Hierarchical Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  J. O'Rourke,et al.  Model-based image analysis of human motion using constraint propagation , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Yee-Hong Yang,et al.  Human body motion segmentation in a complex scene , 1987, Pattern Recognit..

[11]  Hans-Hellmut Nagel,et al.  New likelihood test methods for change detection in image sequences , 1984, Comput. Vis. Graph. Image Process..

[12]  David W. Murray,et al.  Scene Segmentation from Visual Motion Using Global Optimization , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Peter J. Rousseeuw,et al.  Robust regression and outlier detection , 1987 .

[14]  R. F. Rashid,et al.  Towards a system for the interpretation of moving light displays , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Alessandro Neri,et al.  Automatic moving object and background separation , 1998, Signal Process..

[16]  William B. Thompson,et al.  Lower-Level Estimation and Interpretation of Visual Motion , 1981, Computer.

[17]  Y. V. Reddy,et al.  A production system for intelligent monitoring systems , 1988 .

[18]  R. Mackintosh.  Sentinel-a technology for practical automatic monitoring of busy and complex scenes , 1992, Proceedings 1992 International Carnahan Conference on Security Technology: Crime Countermeasures.

[19]  R. Bradbeer.  A medium resolution intelligent video camera , 1995 .

[20]  Roland Mech,et al.  A noise robust method for 2D shape estimation of moving objects in video sequences considering a moving camera , 1998, Signal Process..

[21]  Ming-Chieh Lee,et al.  Semiautomatic segmentation and tracking of semantic video objects , 1998, IEEE Trans. Circuits Syst. Video Technol..

[22]  Koichiro Akita,et al.  Image sequence analysis of real world human motion , 1984, Pattern Recognit..