Movie maps

This paper presents methods for moving image sequence visualization and browsing based on algorithms from computer vision, information visualization and on a hierarchical model for content semantics. We introduce a new method, OM-Images, for the visualization of temporal changes in a moving image sequence. Together with interactive browsing techniques the visualization methods can be used for the exploration of a movie at different levels of abstraction. The proposed levels of abstraction are the physical, image, object or discourse level. The visualization is used to generate (1) static descriptions, which printed on paper yield a "movie book" and (2) interactive documents, e.g. Web pages or special movie browsers. Finally, we give examples of a movie book of a feature length film.

[1]  Wolfgang Effelsberg,et al.  On the detection and recognition of television commercials , 1997, Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[2]  Boon-Lock Yeo,et al.  Video query: Research directions , 1998, IBM J. Res. Dev..

[3]  Hiroshi Hamada,et al.  Video Handling with Music and Speech Detection , 1998, IEEE Multim..

[4]  Heimo Mueller-Seelich,et al.  Visualizing artifacts, meta-information, and quality parameters of image sequences , 1998, Electronic Imaging.

[5]  Avideh Zakhor,et al.  Motion indexing of video , 1997, Proceedings of International Conference on Image Processing.

[6]  David Bordwell,et al.  Film Art: An Introduction , 1979 .

[7]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[8]  Werner Faulstich.  Einführung in die Filmanalyse , 1980 .

[9]  Toshikazu Kato,et al.  Database architecture for content-based image retrieval , 1992, Electronic Imaging.

[10]  H. Müller-Seelich,et al.  VICAR - An Automatic Video Annotation System , 1998 .

[11]  Shih-Fu Chang,et al.  MetaSEEk: a content-based metasearch engine for images , 1997, Electronic Imaging.

[12]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[13]  Boon-Lock Yeo,et al.  Video browsing using clustering and scene transitions on compressed sequences , 1995, Electronic Imaging.

[14]  Shih-Fu Chang,et al.  Clustering methods for video browsing and annotation , 1996, Electronic Imaging.

[15]  Edoardo Ardizzone,et al.  Video indexing using optical flow field , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[16]  John P. Eakins.  Retrieval of trade mark images by shape feature , 1994 .

[17]  Dragutin Petkovic,et al.  Content-Based Representation and Retrieval of Visual Media: A State-of-the-Art Review , 1996 .

[18]  Remi Depommier,et al.  Content-based browsing of video sequences , 1994, MULTIMEDIA '94.

[19]  Hideo Hashimoto,et al.  Video indexing using motion vectors , 1992, Other Conferences.

[20]  Jeho Nam,et al.  Motion-based video object indexing using multiresolution analysis , 1998, Electronic Imaging.