Multimedia Databases and Data Management: A Survey

The exponential growth of the technological advancements has resulted in high-resolution devices, such as digital cameras, scanners, monitors, and printers, which enable the capturing and displaying of multimedia data in high-density storage devices. Furthermore, more and more applications need to live with multimedia data. However, the gap between the characteristics of various media types and the application requirements has created the need to develop advanced techniques for multimedia data management and the extraction of relevant information from multimedia databases. Though many research efforts have been devoted to the areas of multimedia databases and data management, it is still far from maturity. The purpose of this article is to discuss how the existing techniques, methodologies, and tools addressed relevant issues and challenges to enable a better understanding in multimedia databases and data management. The focuses include: 1 how to develop a formal structure that can be used to capture the distinguishing content of the media data in a multimedia database MMDB and to form an abstract space for the data to be queried; 2 how to develop advanced content analysis and retrieval techniques that can be used to bridge the gaps between the semantic meaning and low-level media characteristics to improve multimedia information retrieval; and 3 how to develop query mechanisms that can handle complex spatial, temporal, and/or spatio-temporal relationships of multimedia data to answer the imprecise and incomplete queries issued to an MMDB.

[1]  Thanasis Hadzilacos,et al.  Semantic Abstractions in the Multimedia Domain , 2003, IEEE Trans. Knowl. Data Eng..

[2]  Andreas Girgensohn,et al.  Temporal event clustering for digital photo collections , 2005, ACM Trans. Multim. Comput. Commun. Appl..

[3]  John R. Smith,et al.  A multi-modal system for the retrieval of semantic video events , 2004, Comput. Vis. Image Underst..

[4]  Donguk Cheong,et al.  A Simulation for Improving Teachers' Motivational Skills , 2011 .

[5]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[6]  Wei-bang Chen,et al.  Authorship Detection and Encoding for eBay Images , 2011, Int. J. Multim. Data Eng. Manag..

[7]  Mei-Ling Shyu,et al.  Mining High-Level Features from Video Using Associations and Correlations , 2009, 2009 IEEE International Conference on Semantic Computing.

[8]  M. Tamer Özsu,et al.  Foundation of the DISIMA Image Query Languages , 2004, Multimedia Tools and Applications.

[9]  Rangasami L. Kashyap,et al.  Semantic Models for Multimedia Database Searching and Browsing , 2000, Advances in Database Systems.

[10]  Juergen Seitz,et al.  Digital Watermarking for Digital Media , 2005 .

[11]  Riccardo Leonardi,et al.  Semantic indexing of soccer audio-visual sequences: a multimodal approach based on controlled Markov chains , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Joaquín Borrego-Díaz,et al.  Ontological Dimensions of Semantic Mobile Web 2.0: First Principles , 2011 .

[13]  Wei-Ying Ma,et al.  Learning a semantic space from user's relevance feedback for image retrieval , 2003, IEEE Trans. Circuits Syst. Video Technol..

[14]  Tat-Seng Chua,et al.  Detection of human faces in a compressed domain for video stratification , 2002, The Visual Computer.

[15]  V. S. Subrahmanian Principles of Multimedia Database Systems , 1998 .

[16]  M. Cruz-cunha,et al.  Handbook of Research on Mobility and Computing : Evolving Technologies and Ubiquitous Impacts , 2011 .

[17]  Irene Cheng,et al.  VisualMOQL: the DISIMA visual query language , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[18]  Shu-Ching Chen,et al.  Introduction to the special issue on multimedia databases , 2006, Inf. Syst..

[19]  Lynne Dunckley,et al.  Multimedia Databases: An Object Relational Approach , 2003 .

[20]  Jianping Fan,et al.  Multi-level annotation of natural scenes using dominant image components and semantic concepts , 2004, MULTIMEDIA '04.

[21]  Hong Heather Yu,et al.  Overview and Future Trends of Multimedia Research for Content Access and Distribution , 2007, Int. J. Semantic Comput..

[22]  Calin Gurau Characteristics, Limitations, and Potential of Advergames , 2009 .

[23]  Shu-Ching Chen,et al.  Modeling Semantic Concepts and User Preferences in Content-Based Video Retrieval , 2007, Int. J. Semantic Comput..

[24]  Stuart Harvey Rubin,et al.  Multispectral Image Compression, Intelligent Analysis, and Hierarchical Search in Image Databases , 2012, Int. J. Multim. Data Eng. Manag..

[25]  Takeo Kanade,et al.  Object Detection Using the Statistics of Parts , 2004, International Journal of Computer Vision.

[26]  Harald Kosch,et al.  Distributed Multimedia Database Technologies Supported by MPEG-7 and MPEG-21 , 2003 .

[27]  Xin Luo,et al.  Encyclopedia of Multimedia Technology and Networking , 2008 .

[28]  Shu-Ching Chen,et al.  Guest Editorial: Introduction to the Special Issue , 2005, Multimedia Tools and Applications.

[29]  Mahbubur Rahman Syed Multimedia technologies : concepts, methodologies, tools, and applications / Syed Mahbubur Rahman [editor]. , 2008 .

[30]  Shu-Ching Chen,et al.  Correlation-Based Video Semantic Concept Detection Using Multiple Correspondence Analysis , 2008, 2008 Tenth IEEE International Symposium on Multimedia.

[31]  Sara de Freitas,et al.  Massively multiplayer online role-play games for learning , 2008 .

[32]  Kuntal Sengupta,et al.  Framework for real-time behavior interpretation from traffic video , 2005, IEEE Transactions on Intelligent Transportation Systems.

[33]  Clark Aldrich,et al.  An Overview of Gaming Terminology: Chapters I – LXXVI , 2009 .

[34]  Nevenka Dimitrova Context and Memory in Multimedia Content Analysis , 2004, IEEE Multim..

[35]  Ismail Khalil,et al.  Handbook of Research on Mobile Multimedia , 2006 .

[36]  Ismail Khalil,et al.  Innovations in Mobile Multimedia Communications and Applications: New Technologies , 2011 .

[37]  Yuping Yang,et al.  Personalized redirection of communication and data , 2004 .

[38]  Anuj Srivastava,et al.  Statistical shape analysis: clustering, learning, and testing , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Min Chen,et al.  Video Semantic Event/Concept Detection Using a Subspace-Based Multimedia Data Mining Framework , 2008, IEEE Transactions on Multimedia.

[40]  Craig Davis,et al.  Leveraging Digital Multimedia Training for At-Risk Teens , 2008 .

[41]  Min Chen,et al.  Probabilistic semantic network-based image retrieval using MMM and relevance feedback , 2006, Multimedia Tools and Applications.

[42]  Hamid Soltanian-Zadeh,et al.  Radon transform orientation estimation for rotation invariant texture analysis , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.