Content-based Retrieval of Flash TM Movies : Research Issues , Generic Framework , and Future Directions *

As a prevailing web media format, nowadays FlashTM movies are created, delivered, and viewed by over millions of users in their daily experiences with the Internet. However, issues regarding the indexing and retrieval of Flash movies are unfortunately overlooked by the research community, which severely restrict the utilization of the extremely valuable Flash resource. A close examination reveals that the intrinsic complexity of a Flash movie, including its heterogeneous media components, its dynamic nature, and user interactivity, makes content-based Flash retrieval a host of research issues not thoroughly addressed by the existing techniques. As the first endeavor in this area, we propose a generic framework termed as FLAME (FLash Access and Management Environment) embodying a 3-layer structure that addresses the representation, indexing, and retrieval of Flash movies by mining and understanding of the movie content. An experimental prototype for Flash retrieval is implemented to verify the feasibility and effectiveness of FLAME, and future research directions on Flash management and retrieval are discussed in details.

[1]  Vijay V. Raghavan,et al.  Design and evaluation of algorithms for image retrieval by spatial similarity , 1995, TOIS.

[2]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  V. S. Subrahmanian,et al.  An algebra for creating and querying multimedia presentations , 2000, Multimedia Systems.

[4]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[5]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[6]  Arif Ghafoor,et al.  An approach for video meta-data modeling and query processing , 1999, MULTIMEDIA '99.

[7]  Qing Li,et al.  Developing an Object-Oriented Video Database System with Spatio-Temporal Reasoning Capabilities , 1999, ER.

[8]  Mingjing Li,et al.  Ubiquitous media agents for managing personal multimedia files , 2001, MULTIMEDIA '01.

[9]  Rune Hjelsvold,et al.  Modelling and Querying Video Data , 1994, VLDB.

[10]  Borivoje Furht,et al.  Handbook on Multimedia Computing , 1998 .

[11]  Hanan Samet,et al.  The Quadtree and Related Hierarchical Data Structures , 1984, CSUR.

[12]  Shi-Kuo Chang,et al.  Iconic Indexing by 2-D Strings , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  W. Niblack SlideFinder: a tool for browsing presentation graphics using content-based retrieval , 1999, Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL'99).

[14]  Gultekin Özsoyoglu,et al.  Temporal and Real-Time Databases: A Survey , 1995, IEEE Trans. Knowl. Data Eng..

[15]  Jonathan Foote,et al.  An overview of audio information retrieval , 1999, Multimedia Systems.

[16]  Thomas S. Huang,et al.  Content-based image retrieval with relevance feedback in MARS , 1997, Proceedings of International Conference on Image Processing.

[17]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[18]  Qiang Yang,et al.  Program understanding as constraint satisfaction , 1995, Proceedings of 2nd Working Conference on Reverse Engineering.

[19]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[20]  Yanjun Qi,et al.  Video Classification and Retrieval with the Informedia Digital Video Library System , 2002, TREC.

[21]  Yueting Zhuang,et al.  OCTOPUS: aggressive search of multi-modality data using multifaceted knowledge base , 2002, WWW '02.

[22]  Shih-Fu Chang,et al.  Visually Searching the Web for Content , 1997, IEEE Multim..

[23]  Qiang Yang,et al.  A unified framework for semantics and feature based relevance feedback in image retrieval systems , 2000, ACM Multimedia.

[24]  Shih-Fu Chang,et al.  VideoQ: an automated content based video search system using visual cues , 1997, MULTIMEDIA '97.

[25]  Gultekin Özsoyoglu,et al.  Querying Multimedia Presentations Based on Content , 1999, IEEE Trans. Knowl. Data Eng..