Real Time Video Analysis for Automatic Archive Creation

New and emerging technologies make it possible to capture and deliver digital video information. In general, the techniques used to index video information require source manual intervention, source specific information and/or are computationally expensive. In order to provide access to video footage within seconds of broadcast, we have developed a new pipelined digital video processing architecture which is capable of digitizing, processing, indexing, and compressing video in real time on an inexpensive general purpose computer. These videos were automatically partitioned into short scenes using video, audio and closedcaption information. The resulting scenes are indexed based on their captions and stored in a multimedia database. A client-server-based graphical user interface was developed to enable users to remotely search this archive and view selected video segments over networks of different bandwidths. Additionally, VISION classifies the incoming videos with respect to a taxonomy of categories and will selectively send users videos which match their individual profiles. Recent work has focused on efficient key frame extraction to support browsing and real-time feature extraction to support image-similarity based retrieval.

[1]  David Salesin,et al.  Fast multiresolution image querying , 1995, SIGGRAPH.

[2]  Alexander G. Hauptmann,et al.  Informedia: news-on-demand multimedia information acquisition and retrieval , 1997 .

[3]  Emanuele Trucco,et al.  Computer and Robot Vision , 1995 .

[4]  David K. Gifford,et al.  Composition and Search with a Video Algebra , 1995, IEEE Multim..

[5]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[6]  Michal Irani,et al.  Video indexing based on mosaic representations , 1998, Proc. IEEE.

[7]  Michael D. Rusk.  VISION Digital Video Library System , 2002 .

[8]  Takeo Kanade,et al.  Intelligent Access to Digital Video: Informedia Project , 1996, Computer.

[9]  Ramesh C. Jain,et al.  Digital video segmentation , 1994, MULTIMEDIA '94.

[10]  Shih-Fu Chang,et al.  VideoQ: an automated content based video search system using visual cues , 1997, MULTIMEDIA '97.

[11]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[12]  David Wetherall,et al.  The VuSystem: a programming system for visual processing of digital video , 1994, MULTIMEDIA '94.

[13]  Harpreet S. Sawhney,et al.  Compact Representations of Videos Through Dominant and Multiple Motion Estimation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  John M. Gauch,et al.  Vision: a digital video library , 1996, DL '96.

[15]  Yihong Gong,et al.  Automatic parsing and indexing of news video , 1995, Multimedia Systems.

[16]  Hong Heather Yu,et al.  Scenic classification methods for image and video databases , 1995, Other Conferences.

[17]  Ricardo Baeza-Yates,et al.  Information Retrieval: Data Structures and Algorithms , 1992 .

[18]  Remi Depommier,et al.  Content-based browsing of video sequences , 1994, MULTIMEDIA '94.

[19]  Dragutin Petkovic,et al.  The query by image content (QBIC) system , 1995, SIGMOD '95.

[20]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[21]  Takeo Kanade,et al.  Informedia Digital Video Library , 1995, CACM.

[22]  Stephen W. Smoliar,et al.  Video parsing, retrieval and browsing: an integrated and content-based solution , 1997, MULTIMEDIA '95.

[23]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[24]  K. Wakimoto,et al.  Efficient and Effective Querying by Image Content , 1994 .

[25]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.

[26]  John R. Smith,et al.  Intelligent multimedia information retrieval , 1997 .

[27]  Walter Bender,et al.  Salient video stills: content and context preserved , 1993, MULTIMEDIA '93.

[28]  Fang Liu,et al.  A new Wold ordering for image similarity , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[29]  Wayne H. Wolf,et al.  Key frame selection by motion analysis , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[30]  Shih-Fu Chang,et al.  Querying by color regions using VisualSEEk content-based visual query system , 1997 .

[31]  Jing Xiao,et al.  Content-Based Video Indexing and Retrieval , 2004 .

[32]  Arding Hsu,et al.  Image processing on compressed data for large video databases , 1993, MULTIMEDIA '93.

[33]  Joseph B. Evans,et al.  The Digital Video Library System:Vision and Design , 1994 .