Web search engine multimedia functionality

Web search engines are beginning to offer access to multimedia searching, including audio, video and image searching. In this paper we report findings from a study examining the state of multimedia search functionality on major general and specialized Web search engines. We investigated 102 Web search engines to examine: (1) how many Web search engines offer multimedia searching, (2) the type of multimedia search functionality and methods offered, such as ''query by example'', and (3) the supports for personalization or customization which are accessible as advanced search. Findings include: (1) few major Web search engines offer multimedia searching and (2) multimedia Web search functionality is generally limited. Our findings show that despite the increasing level of interest in multimedia Web search, those few Web search engines offering multimedia Web search, provide limited multimedia search functionality. Keywords are still the only means of multimedia retrieval, while other methods such as ''query by example'' are offered by less than 1% of Web search engines examined.

[1]  Jonathan Walpole,et al.  Storage System Support for Continuous-Media Applications, Part 1: Requirements and Single-Disk Issues , 2004, IEEE Distributed Syst. Online.

[2]  Amanda Spink,et al.  Web Search: Public Searching of the Web , 2011, Information Science and Knowledge Management.

[3]  Milind R. Naphade,et al.  Extracting semantics from audio-visual content: the final frontier in multimedia retrieval , 2002, IEEE Trans. Neural Networks.

[4]  Dragutin Petkovic,et al.  Indexing for complex queries on a query-by-content image database , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[5]  Lie Lu,et al.  Towards a unified framework for content-based audio analysis , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[6]  Jaideep Srivastava,et al.  Evaluating Object DBMSs for Multimedia , 1997, IEEE Multim..

[7]  G. Medioni,et al.  Content-based image retrieval: an overview , 2004 .

[8]  Abdelsalam Helal,et al.  Video Database Systems: Issues, Products and Applications , 1997 .

[9]  Nicu Sebe,et al.  Content-based multimedia information retrieval: State of the art and challenges , 2006, TOMCCAP.

[10]  Sing Bing Kang,et al.  Emerging Topics in Computer Vision , 2004 .

[11]  Atsuo Yoshitaka,et al.  A Survey on Content-Based Retrieval for Multimedia Databases , 1999, IEEE Trans. Knowl. Data Eng..

[12]  Shih-Fu Chang,et al.  Next-generation content representation, creation, and searching for new-media applications in education , 1998 .

[13]  Greg Goth.  Multimedia search: ready or not? , 2004, IEEE Distributed Systems Online.

[14]  Michael J. Swain.  Searching for multimedia on the World Wide Web , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[15]  Amanda Spink,et al.  Multimedia Web searching trends: 1997-2001 , 2003, Inf. Process. Manag..

[16]  Sougata Mukherjea,et al.  Towards a Multimedia World-Wide Web Information Retrieval Engine , 1997, Comput. Networks.

[17]  Qi Tian,et al.  A mid-level representation framework for semantic sports video analysis , 2003, ACM Multimedia.

[18]  Ramesh C. Jain,et al.  Video Data Management Systems: Metadata and Architecture , 1998, Multimedia Data Management.

[19]  R. B. Johnson.  Internet multimedia databases , 1999 .

[20]  Nicu Sebe,et al.  The State of the Art in Image and Video Retrieval , 2003, CIVR.

[21]  Jitendra Malik,et al.  Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Djemel Ziou,et al.  Image Retrieval from the World Wide Web: Issues, Techniques, and Systems , 2004, CSUR.

[23]  Shih-Fu Chang,et al.  Local color and texture extraction and spatial query , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[24]  Amit P. Sheth,et al.  Multimedia Data Management: Using Metadata to Integrate and Apply Digital Media , 1998 .

[25]  Amanda Spink,et al.  Searching multimedia federated content web collections , 2006, Online Inf. Rev..