An Overview of Video Abstraction Techniques

video abstraction, video skimming, video summarization The fast evolution of digital video has brought many new applications. Consequently, research and development of new technologies are greatly needed which will lower the costs of video archiving, cataloging and indexing, as well as improve the efficiency and accessibility of stored videos. Among all possible research areas, video abstraction is one of the most important topics, which helps to enable a quick browsing of a large collection of video data and to achieve efficient content access and representation.

[1]  G W Heiman,et al.  Word intelligibility decrements and the comprehension of time-compressed speech , 1986, Perception & psychophysics.

[2]  Yoshinobu Tonomura,et al.  Video browsing using brightness data , 1991, Other Conferences.

[3]  Michael Mills,et al.  A magnifier tool for video data , 1992, CHI.

[4]  Akio Nagasaka,et al.  Automatic structure visualization for video editing , 1993, INTERCHI.

[5]  Edward H. Adelson,et al.  Representing moving images with layers , 1994, IEEE Trans. Image Process..

[6]  Stephen W. Smoliar,et al.  Content based video indexing and retrieval , 1994, IEEE MultiMedia.

[7]  Remi Depommier,et al.  Content-based browsing of video sequences , 1994, MULTIMEDIA '94.

[8]  Alexander G. Hauptmann,et al.  Text, Speech, and Vision for Video Segmentation: The InformediaTM Project , 1995 .

[9]  Minerva M. Yeung,et al.  Efficient matching and clustering of video shots , 1995, Proceedings., International Conference on Image Processing.

[10]  Yukinobu Taniguchi,et al.  An intuitive and efficient access interface to real-time incoming video based on automatic indexing , 1995, MULTIMEDIA '95.

[11]  M. Smith,et al.  Video Skimming for Quick Browsing based on Audio and Image Characterization , 1995 .

[12]  Ahmed Karmouch,et al.  A multimedia news delivery system over an ATM network , 1995, Proceedings of the International Conference on Multimedia Computing and Systems.

[13]  Behzad Shahraray,et al.  Scene change detection and content-based sampling of video sequences , 1995, Electronic Imaging.

[14]  Behzad Shahraray,et al.  Automatic generation of pictorial transcripts of video programs , 1995, Electronic Imaging.

[15]  Wolfgang Effelsberg,et al.  Abstracting Digital Movies Automatically , 1996, J. Vis. Commun. Image Represent..

[16]  Wayne H. Wolf,et al.  Key frame selection by motion analysis , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[17]  Andrew Heybey,et al.  I/Browse: the Bellcore video library tool kit , 1996, Electronic Imaging.

[18]  Walter Bender,et al.  Salient Stills: Process and Practice , 1996, IBM Syst. J..

[19]  Marco Ceccarelli,et al.  Visual search in a SMASH system , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[20]  Yukinobu Taniguchi,et al.  PanoramaExcerpts: extracting and packing panoramas for video browsing , 1997, MULTIMEDIA '97.

[21]  Michael A. Smith,et al.  Video skimming and characterization through the combination of image and language understanding techniques , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Boon-Lock Yeo,et al.  Video visualization for compact presentation and fast browsing of pictorial content , 1997, IEEE Trans. Circuits Syst. Video Technol..

[23]  Wolfgang Effelsberg,et al.  Video abstracting , 1997, CACM.

[24]  Richard Szeliski,et al.  A layered video object coding system using sprite and affine motion model , 1997, IEEE Trans. Circuits Syst. Video Technol..

[25]  Marco Ceccarelli,et al.  Automation of systems enabling search on stored video data , 1997, Electronic Imaging.

[26]  A. Murat Tekalp,et al.  Multiscale content extraction and representation for video indexing , 1997, Other Conferences.

[27]  Ahmed K. Elmagarmid,et al.  Video Database Systems , 1997, Advances in Database Systems.

[28]  Stephen W. Smoliar,et al.  An integrated system for content-based video retrieval and browsing , 1997, Pattern Recognit..

[29]  M. Ibrahim Sezan,et al.  Hierarchical video summarization , 1998, Electronic Imaging.

[30]  Michael G. Christel,et al.  Evolving video skims into useful multimedia abstractions , 1998, CHI.

[31]  Sansanee Auephanwiriyakul,et al.  Fuzzy shot clustering to support networked video databases , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[32]  Avideh Zakhor,et al.  Content analysis of video using principal components , 1998, IEEE Trans. Circuits Syst. Video Technol..

[33]  Yueting Zhuang,et al.  Adaptive key frame extraction using unsupervised clustering , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[34]  Nuno Vasconcelos,et al.  A spatiotemporal motion model for video summarization , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[35]  David S. Doermann,et al.  Video summarization by curve simplification , 1998, MULTIMEDIA '98.

[36]  Michal Irani,et al.  Video indexing based on mosaic representations , 1998, Proc. IEEE.

[37]  Andreas Girgensohn,et al.  Time-Constrained Keyframe Selection Technique , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[38]  Shih-Ping Liou,et al.  Automatic key-frame selection for content-based video indexing and access , 1999, Electronic Imaging.

[39]  Anoop Gupta,et al.  Auto-summarization of audio-video presentations , 1999, MULTIMEDIA '99.

[40]  Yihong Gong,et al.  Lessons Learned from Building a Terabyte Digital Video Library , 1999, Computer.

[41]  Rainer Lienhart.  Dynamic video summarization of home video , 1999, Electronic Imaging.

[42]  Jeho Nam,et al.  Video abstract of video , 1999, 1999 IEEE Third Workshop on Multimedia Signal Processing (Cat. No.99TH8451).

[43]  Shingo Uchihashi,et al.  Video Manga: generating semantically meaningful video summaries , 1999, MULTIMEDIA '99.

[44]  Alan Hanjalic,et al.  An integrated scheme for automated video abstraction based on unsupervised cluster-validity analysis , 1999, IEEE Trans. Circuits Syst. Video Technol..

[45]  Alessandro Neri,et al.  Automatic key frame selection using a wavelet-based approach , 1999, Optics & Photonics.

[46]  Anoop Gupta,et al.  Time-compression: systems concerns, usage, and benefits , 1999, CHI '99.

[47]  Mohan S. Kankanhalli,et al.  Video Summarization Using R-Sequences , 2000, Real Time Imaging.

[48]  Jenq-Neng Hwang,et al.  An integrated scheme for object-based video abstraction , 2000, ACM Multimedia.

[49]  Shih-Ping Liou,et al.  Videoabstract: a hybrid approach to generate semantically meaningful video summaries , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[50]  Frédéric Dufaux,et al.  Key Frame Selection to Represent a Video , 2000, ICIP.

[51]  Dragutin Petkovic,et al.  Using audio time scale modification for video browsing , 2000, Proceedings of the 33rd Annual Hawaii International Conference on System Sciences.

[52]  Anthony Stefanidis,et al.  Summarizing video datasets in the spatiotemporal domain , 2000, Proceedings 11th International Workshop on Database and Expert Systems Applications.

[53]  Xin Liu,et al.  Generating optimal video summaries , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[54]  Stefanos D. Kollias,et al.  Non-sequential video content representation using temporal variation of feature vectors , 2000, 2000 Digest of Technical Papers. International Conference on Consumer Electronics. Nineteenth in the Series (Cat. No.00CH37102).

[55]  Daniel M. Russell.  A design pattern-based video summarization technique: moving from low-level signals to high-level structure , 2000, Proceedings of the 33rd Annual Hawaii International Conference on System Sciences.

[56]  F. Dirfaux.  Key frame selection to represent a video , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[57]  Stefanos D. Kollias,et al.  A fuzzy video content representation for video summarization and content-based retrieval , 2000, Signal Process..