Overview and Future Trends of Multimedia Research for Content Access and Distribution

The advances in information technology, computational capability, and communication networks have enabled large-scale data collection and distribution of vast amounts of multimedia data available to consumer and enterprise applications. With the proliferation of multimedia data and ever-growing requests for multimedia applications, reliable and efficient tools and techniques are urgently sought for multimedia content analysis and retrieval, as well as secure media streaming, distribution or communication. Though many research efforts have been devoted to these aspects, it is still far from maturity and there exist many open issues. In this paper, an overview of the challenges and issues as well as future trends on multimedia content access and distribution will be discussed. The focuses include: (i) how to bridge the gaps between the semantic meaning and low-level media characteristics; (ii) how to handle user perception subjectivity problem; (iii) how to provide multimedia network communication support f...

[1]  Marina Bosi.  Digital Rights Management Systems , 2006 .

[2]  Scott Moskowitz.  Bandwidth as Currency , 2003, IEEE Multim..

[3]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[4]  Lei Chen,et al.  Modeling of video objects in a video databases , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[5]  Amarnath Gupta,et al.  Visual information retrieval , 1997, CACM.

[6]  Deepa Kundur,et al.  On Peer-to-Peer Multimedia Content Access and Distribution , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[7]  Hong Heather Yu,et al.  Multimedia data recovery using information hiding , 2000, Globecom '00 - IEEE. Global Telecommunications Conference. Conference Record (Cat. No.00CH37137).

[8]  Gregory W. Wornell,et al.  Quantization index modulation: A class of provably good methods for digital watermarking and information embedding , 2001, IEEE Trans. Inf. Theory.

[9]  Xu Hong-wei.  Temporal Role-Based Access Control Model , 2009 .

[10]  Bernd Girod,et al.  Scalar Costa scheme for information embedding , 2003, IEEE Trans. Signal Process..

[11]  Atsuo Yoshitaka,et al.  A Survey on Content-Based Retrieval for Multimedia Databases , 1999, IEEE Trans. Knowl. Data Eng..

[12]  Dai Yiqi,et al.  Semi-fragile watermarking for image content authentication , 2004, Proceedings 7th International Conference on Signal Processing, 2004. Proceedings. ICSP '04. 2004..

[13]  James C. French,et al.  Improving Image Retrieval Effectiveness via Multiple Queries , 2003, MMDB '03.

[14]  Shih-Fu Chang,et al.  A fully automated content-based video search engine supporting spatiotemporal queries , 1998, IEEE Trans. Circuits Syst. Video Technol..

[15]  Mohan S. Kankanhalli,et al.  Video Summarization Using R-Sequences , 2000, Real Time Imaging.

[16]  Irwin King,et al.  Distributed content-based visual information retrieval system on peer-to-peer networks , 2004, TOIS.

[17]  Mohan S. Kankanhalli,et al.  Lossless Watermarking Considering the Human Visual System , 2003, IWDW.

[18]  Dong-Seok Jeong,et al.  Detection of video scene breaks using directional informations in DCT domain , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[19]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[20]  Riccardo Leonardi,et al.  Semantic indexing of soccer audio-visual sequences: a multimodal approach based on controlled Markov chains , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Bo Zhang,et al.  An effective region-based image retrieval framework , 2002, MULTIMEDIA '02.

[22]  Edward J. Delp,et al.  Security of digital entertainment content from creation to consumption , 2001, Optics + Photonics.

[23]  Rui Du,et al.  Invertible authentication watermark for JPEG images , 2001, Proceedings International Conference on Information Technology: Coding and Computing.

[24]  Darko Kirovski,et al.  Multimedia Security Handbook , 2004 .

[25]  Edward Y. Chang,et al.  Support vector machine active learning for image retrieval , 2001, MULTIMEDIA '01.

[26]  Shu-Ching Chen,et al.  SMARXO: towards secured multimedia applications by adopting RBAC, XML and object-relational database , 2004, MULTIMEDIA '04.

[27]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.

[28]  Shu-Ching Chen,et al.  An enhanced query model for soccer video retrieval using temporal relationships , 2005, 21st International Conference on Data Engineering (ICDE'05).

[29]  Michael R. Lyu,et al.  A novel log-based relevance feedback technique in content-based image retrieval , 2004, MULTIMEDIA '04.

[30]  Yücel Altunbasak,et al.  Error-resilient image and video transmission over the Internet using unequal error protection , 2003, IEEE Trans. Image Process..

[31]  Antony I. T. Rowstron,et al.  Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems , 2001, Middleware.

[32]  Jianping Fan,et al.  A Video Database Management System for Advancing Video Database Research , 2002, Multimedia Information Systems.

[33]  Jake K. Aggarwal,et al.  CIRES: a system for content-based retrieval in digital image libraries , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..

[34]  Thomas S. Huang,et al.  Supporting similarity queries in MARS , 1997, MULTIMEDIA '97.

[35]  Chai Wah Wu,et al.  On the design of content-based multimedia authentication systems , 2002, IEEE Trans. Multim..

[36]  Jiwu Huang,et al.  A robust DWT-based video watermarking algorithm , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[37]  Arif Ghafoor,et al.  An approach for video meta-data modeling and query processing , 1999, MULTIMEDIA '99.

[38]  Alan Hanjalic,et al.  A New Method for Key Frame Based Video Content Representation , 1998, Image Databases and Multi-Media Search.

[39]  Thierry Pun,et al.  Attack modelling: towards a second generation watermarking benchmark , 2001, Signal Process..

[40]  Mark Nelson,et al.  The Data Compression Book , 2009 .

[41]  C.-C. Jay Kuo,et al.  Introduction to Content‐Based Image Retrieval—Overview of Key Techniques , 2002 .

[42]  Ramesh C. Jain,et al.  Knowledge-guided parsing in video databases , 1993, Electronic Imaging.

[43]  Stuart Harvey Rubin,et al.  An Integrated and Interactive Video Retrieval Framework with Hierarchical Learning Models and Semantic Clustering Strategy , 2006, 2006 IEEE International Conference on Information Reuse & Integration.

[44]  Khalid Sayood,et al.  Introduction to Data Compression , 1996 .

[45]  Yoshinobu Tonomura,et al.  Projection Detecting Filter for Video Cut Detection , 1993, ACM Multimedia.

[46]  Kuo-Chin Fan,et al.  A motion-flow-based fast video retrieval system , 2005, MIR '05.

[47]  Edwin K. P. Chong,et al.  Efficient multicast packet authentication using signature amortization , 2002, Proceedings 2002 IEEE Symposium on Security and Privacy.

[48]  Walid G. Aref,et al.  Video query processing in the VDBMS testbed for video database research , 2003, MMDB '03.

[49]  Ahmet M. Eskicioglu.  Protecting Intellectual Property in Digital Multimedia Networks , 2003, Computer.

[50]  Henning Schulzrinne,et al.  RTP: A Transport Protocol for Real-Time Applications , 1996, RFC.

[51]  Min Chen,et al.  A latent semantic indexing based method for solving multiple instance learning problem in region-based image retrieval , 2005, Seventh IEEE International Symposium on Multimedia (ISM'05).

[52]  Yuzhuo Zhong,et al.  Robust approach to video segmentation using compressed data , 1997, Electronic Imaging.

[53]  Mustaque Ahamad,et al.  Generalized role-based access control , 2001, Proceedings 21st International Conference on Distributed Computing Systems.

[54]  Qibin Sun,et al.  5 – Multimedia Authentication , 2006 .

[55]  Richard J. Qian,et al.  Detecting semantic events in soccer games: towards a complete solution , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[56]  Basit Shafiq,et al.  A model for secure multimedia document database system in a distributed environment , 2002, IEEE Trans. Multim..

[57]  Thomas S. Huang,et al.  Water-filling: a novel way for image structural feature extraction , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[58]  Kyuseok Shim,et al.  WALRUS: A Similarity Retrieval Algorithm for Image Databases , 2004, IEEE Trans. Knowl. Data Eng..

[59]  C.-C. Jay Kuo,et al.  Design of integrated multimedia compression and encryption systems , 2005, IEEE Transactions on Multimedia.

[60]  Shih-Fu Chang,et al.  Semifragile watermarking for authenticating JPEG visual content , 2000, Electronic Imaging.

[61]  Yixin Chen,et al.  A Region-Based Fuzzy Feature Matching Approach to Content-Based Image Retrieval , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[62]  Ingemar J. Cox,et al.  The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments , 2000, IEEE Trans. Image Process..

[63]  Edward J. Delp,et al.  Temporal synchronization in video watermarking , 2004, IEEE Trans. Signal Process..

[64]  David R. Karger,et al.  Chord: a scalable peer-to-peer lookup protocol for internet applications , 2003, TNET.

[65]  Shu-Ching Chen,et al.  Video Database Modeling and Temporal Pattern Retrieval using Hierarchical Markov Model Mediator , 2006, 22nd International Conference on Data Engineering Workshops (ICDEW'06).

[66]  Yixin Chen,et al.  Image Categorization by Learning and Reasoning with Regions , 2004, J. Mach. Learn. Res..

[67]  Mauro Barni,et al.  Advantages and drawbacks of multiplicative spread spectrum watermarking , 2003, IS&T/SPIE Electronic Imaging.

[68]  Elisa Bertino,et al.  TRBAC: a temporal role-based access control model , 2000, RBAC '00.

[69]  Shih-Fu Chang,et al.  Unsupervised discovery of multilevel statistical video structures using hierarchical hidden Markov models , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[70]  Lei Tang,et al.  Methods for encrypting and decrypting MPEG video data efficiently , 1997, MULTIMEDIA '96.

[71]  Hong Heather Yu,et al.  Multiresolution video segmentation using wavelet transformation , 1997, Electronic Imaging.

[72]  Ramin Zabih,et al.  Comparing images using color coherence vectors , 1997, MULTIMEDIA '96.

[73]  C.-C. Jay Kuo,et al.  Rule-based video classification system for basketball video indexing , 2000, MULTIMEDIA '00.

[74]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[75]  Min Chen,et al.  Affinity relation discovery in image database clustering and content-based retrieval , 2004, MULTIMEDIA '04.

[76]  Waleed E. Farag,et al.  Video Content-Based Retrieval Techniques , 2005, Encyclopedia of Information Science and Technology.

[77]  Min Chen,et al.  A multimodal data mining framework for soccer goal detection based on decision tree logic , 2006, Int. J. Comput. Appl. Technol..

[78]  Ilaria Bartolini,et al.  Windsurf: region-based image retrieval using wavelets , 1999, Proceedings. Tenth International Workshop on Database and Expert Systems Applications. DEXA 99.

[79]  Alexandra Psarrou,et al.  Key-frame extraction algorithm using entropy difference , 2004, MIR '04.

[80]  Chang Nian Zhang,et al.  A Criterion-Based Role-Based Multilayer Access Control Model for Multimedia Applications , 2006, Eighth IEEE International Symposium on Multimedia (ISM'06).

[81]  Vittorio Castelli,et al.  Image Databases: Search and Retrieval of Digital Imagery , 2002 .

[82]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying scene breaks , 1995, MULTIMEDIA '95.

[83]  Darko Kirovski,et al.  Blind pattern matching attack on watermarking systems , 2003, IEEE Trans. Signal Process..

[84]  Kien A. Hua,et al.  ZIGZAG: an efficient peer-to-peer scheme for media streaming , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[85]  Helen J. Wang,et al.  Distributing streaming media content using cooperative networking , 2002, NOSSDAV '02.

[86]  Thijs Westerveld,et al.  A dynamic probabilistic multimedia retrieval model , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[87]  Min Chen,et al.  A decision tree-based multimodal data mining framework for soccer goal detection , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[88]  A. Murat Tekalp,et al.  Automatic Soccer Video Analysis and Summarization , 2003, IS&T/SPIE Electronic Imaging.

[89]  Anoop Gupta,et al.  Automatically extracting highlights for TV Baseball programs , 2000, ACM Multimedia.

[90]  Chengcui Zhang,et al.  A Dynamic User Concept Pattern Learning Framework for Content-Based Image Retrieval , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[91]  Iwan Setyawan,et al.  Synchronization-insensitive video watermarking using structured noise pattern , 2002, IS&T/SPIE Electronic Imaging.

[92]  Jian Lu,et al.  Signal processing for Internet video streaming: a review , 2000, Electronic Imaging.

[93]  Edward J. Delp,et al.  Advances in Digital Video Content Protection , 2005, Proceedings of the IEEE.

[94]  Wenjun Zeng,et al.  Efficient frequency domain video scrambling for content access control , 1999, MULTIMEDIA '99.

[95]  Wenjun Zeng.  Format-Compliant Content Protection , 2006 .

[96]  Nasir Memon,et al.  Secret and public key image watermarking schemes for image authentication and ownership verification , 2001, IEEE Trans. Image Process..

[97]  Chng Eng Siong,et al.  Automatic replay generation for soccer video broadcasting , 2004, MULTIMEDIA '04.

[98]  Chengcui Zhang,et al.  Innovative Shot Boundary Detection for Video Indexing , 2005 .

[99]  Ben Y. Zhao,et al.  Tapestry: a resilient global-scale overlay for service deployment , 2004, IEEE Journal on Selected Areas in Communications.

[100]  George Tzanetakis,et al.  Content-based retrieval of music in scalable peer-to-peer networks , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[101]  Wenjun Zeng,et al.  Efficient frequency domain selective scrambling of digital video , 2003, IEEE Trans. Multim..

[102]  Gonzalo R. Arce,et al.  Approximate image message authentication codes , 2001, IEEE Trans. Multim..

[103]  Shih-Fu Chang,et al.  Event detection in baseball video using superimposed caption recognition , 2002, MULTIMEDIA '02.

[104]  Nasir D. Memon,et al.  On sequential watermark detection , 2003, IEEE Trans. Signal Process..

[105]  Lei Chen,et al.  Modeling Video Data for Content Based Queries: Extending the DISIMA Image Data Model , 2003, MMM.

[106]  Mei-Ling Shyu.  A Stochastic Content-Based Image Retrieval Mechanism , 2002 .

[107]  Elisa Bertino,et al.  Dependencies and separation of duty constraints in GTRBAC , 2003, SACMAT '03.

[108]  Rangasami L. Kashyap,et al.  Video scene change detection method using unsupervised segmentation and object tracking , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[109]  Noboru Babaguchi,et al.  Event based indexing of broadcasted sports video by intermodal collaboration , 2002, IEEE Trans. Multim..

[110]  Shih-Fu Chang,et al.  Structural and semantic analysis of video , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[111]  Young-Min Kim,et al.  Fast Scene Change Detection using Direct Feature Extraction from MPEG Compressed Videos , 2000, IEEE Trans. Multim..

[112]  Min Chen,et al.  Probabilistic semantic network-based image retrieval using MMM and relevance feedback , 2006, Multimedia Tools and Applications.

[113]  Ravi S. Sandhu,et al.  Role-Based Access Control Models , 1996, Computer.

[114]  Wei-Ying Ma,et al.  Learning a semantic space from user's relevance feedback for image retrieval , 2003, IEEE Trans. Circuits Syst. Video Technol..

[115]  Chengcui Zhang,et al.  A Stochastic and Content-Based Image Retrieval Mechanism , 2008 .

[116]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[117]  Adnan M. Alattar,et al.  Digital watermarking of low bit-rate advanced simple profile MPEG-4 compressed video , 2003, IEEE Trans. Circuits Syst. Video Technol..

[118]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[119]  Michael L. Creech,et al.  FotoFile: a consumer multimedia organization and retrieval system , 1999, CHI '99.

[120]  Jessica J. Fridrich,et al.  Distortion-Free Data Embedding for Images , 2001, Information Hiding.

[121]  Scott Moskowitz.  Introduction—Digital Rights Management , 2006 .

[122]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[123]  S. Pereira,et al.  Attacks on digital watermarks: classification, estimation based attacks, and benchmarks , 2001, IEEE Communications Magazine.

[124]  C.-C.J. Kuo,et al.  Interactive image retrieval: concept, procedure and tools , 1998, Conference Record of Thirty-Second Asilomar Conference on Signals, Systems and Computers (Cat. No.98CH36284).

[125]  Kuntal Sengupta,et al.  Framework for real-time behavior interpretation from traffic video , 2005, IEEE Transactions on Intelligent Transportation Systems.

[126]  Minerva M. Yeung,et al.  An invisible watermarking technique for image verification , 1997, Proceedings of International Conference on Image Processing.