Let's talk about it: dialogues with multimedia databases: Database support for human activity

We describe two scenarios of user tasks in which access to multimedia data plays a significant role. Because current multimedia databases cannot support these tasks, we introduce three new requirements on multimedia databases: multimedia objects should be active objects, querying is an interaction process, and query processing uses multiple representations. We discuss three techniques to handle multimedia objects as active objects. Also, we introduce a promising database architecture to meet the new user requirements. Agents within the database handle objects' representations, and a search engine on top of a conventional database handles relevance feedback and multiple representations.

[1]  Dean Daniels,et al.  Query Processing in R* , 1985, Query Processing in Database Systems.

[2]  G. Miller,et al.  Language and Perception , 1976 .

[3]  Takeo Kanade,et al.  Intelligent Access to Digital Video: Informedia Project , 1996, Computer.

[4]  Roel Vertegaal,et al.  Intuitive Human Interfaces for an Audio-database , 1994, IDS.

[5]  Tom Minka,et al.  Interactive learning with a "society of models" , 1997, Pattern Recognit..

[6]  John D. Barrow,et al.  The artful universe : the cosmic source of human creativity , 1995 .

[7]  Amarnath Gupta,et al.  Visual information retrieval , 1997, CACM.

[8]  W. Bruce Croft,et al.  The INQUERY Retrieval System , 1992, DEXA.

[9]  Thomas S. Huang,et al.  Supporting similarity queries in MARS , 1997, MULTIMEDIA '97.

[10]  Pattie Maes,et al.  Social information filtering: algorithms for automating “word of mouth” , 1995, CHI '95.

[11]  Christos Faloutsos,et al.  Searching Multimedia Databases by Content , 1996, Advances in Database Systems.

[12]  Betty Edwards Drawing on the right side of the brain , 1981 .

[13]  Arjen P. de Vries,et al.  Television Information Filtering Through Speech Recognition , 1996, IDMS.

[14]  Douglas Keislar,et al.  Content-Based Classification, Search, and Retrieval of Audio , 1996, IEEE Multim..

[15]  Gerard Salton,et al.  Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer , 1989 .

[16]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.