Automatic video indexing via object motion analysis

To assist human analysis of video data, a technique has been developed to perform automatic, content-based video indexing from object motion. Moving objects are detected in the video sequence using motion segmentation methods. By tracking individual objects through the segmented data, a symbolic representation of the video is generated in the form of a directed graph describing the objects and their movement. This graph is then annotated using a rule-based classification scheme to identify events of interest, e.g., appearance/disappearance, deposit/removal, entrance/exit, and motion/rest of objects. One may then use an index into the motion graph instead of the raw data to analyse the semantic content of the video. Application of this technique to surveillance video analysis is discussed.

[1]  Masato Kurokawa,et al.  Method for retrieving sequences of images on the basis of motion analysis , 1992, Electronic Imaging.

[2]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[3]  Hideo Hashimoto,et al.  Video indexing using motion vectors , 1992, Other Conferences.

[4]  Ramesh C. Jain,et al.  Knowledge-guided parsing in video databases , 1993, Electronic Imaging.

[5]  Glorianna Davenport,et al.  Cinematic primitives for multimedia , 1991, IEEE Computer Graphics and Applications.

[6]  Remi Depommier,et al.  Content-based browsing of video sequences , 1994, MULTIMEDIA '94.

[7]  Suh-Yin Lee,et al.  Video indexing: an approach based on moving object and track , 1993, Electronic Imaging.

[8]  Aaron F. Bobick,et al.  Closed-world tracking , 1995, Proceedings of IEEE International Conference on Computer Vision.

[9]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[10]  Jake K. Aggarwal,et al.  Extraction of moving object descriptions via differencing , 1982, Comput. Graph. Image Process..

[11]  Gary Chartrand,et al.  Applied and algorithmic graph theory , 1992 .

[12]  Jake K. Aggarwal,et al.  Segmentation through the detection of changes due to motion , 1979 .

[13]  Masahiro Shibata,et al.  Temporal segmentation method for video sequence , 1992, Other Conferences.

[14]  P. Anandan,et al.  A unified approach to moving object detection in 2D and 3D scenes , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[15]  J. Sklansky,et al.  Segmentation of people in motion , 1991, Proceedings of the IEEE Workshop on Visual Motion.