Retrieval effectiveness of image search engines

The purpose of this study is to explore the retrieval effectiveness of three image search engines (ISE) – Google Images, Yahoo Image Search and Picsearch in terms of their image retrieval capability. It is an effort to carry out a Cranfield experiment to know how efficient the commercial giants in the image search are and how efficient an image specific search engine is.,The keyword search feature of three ISEs – Google images, Yahoo Image Search and Picsearch – was exploited to make search with keyword captions of photos as query terms. Selected top ten images were used to act as a testbed for the study, as images were searched in accordance with features of the test bed. Features to be looked for included size (1200 × 800), format of images (JPEG/JPG) and the rank of the original image retrieved by ISEs under study. To gauge the overall retrieval effectiveness in terms of set standards, only first 50 result hits were checked. Retrieval efficiency of select ISEs were examined with respect to their precision and relative recall.,Yahoo Image Search outscores Google Images and Picsearch both in terms of precision and relative recall. Regarding other criteria – image size, image format and image rank in search results, Google Images is ahead of others.,The study only takes into consideration basic image search feature, i.e. text-based search.,The study implies that image search engines should focus on relevant descriptions. The study evaluated text-based image retrieval facilities and thereby offers a choice to users to select best among the available ISEs for their use.,The study provides an insight into the effectiveness of the three ISEs. The study is one of the few studies to gauge retrieval effectiveness of ISEs. Study also produced key findings that are important for all ISE users and researchers and the Web image search industry. Findings of the study will also prove useful for search engine companies to improve their services.

[1]  Nadine Höchstötter,et al.  Standard parameters for searching behaviour in search engines and their empirical evaluation , 2009, J. Inf. Sci..

[2]  Wenzhao Li,et al.  A survey of sketch-based image retrieval , 2018, Machine Vision and Applications.

[3]  Jialie Shen,et al.  The effects of multiple query evidences on social image retrieval , 2014, Multimedia Systems.

[4]  Sanjib Kumar Deka,et al.  Performance evaluation and comparison of the five most used search engines in retrieving web resources , 2010, Online Inf. Rev..

[5]  Peter Bailey,et al.  Measuring Search Engine Quality , 2001, Information Retrieval.

[6]  Charles Oppenheim,et al.  The evaluation of WWW search engines , 2000, J. Documentation.

[7]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[8]  Monica Landoni,et al.  Is Google the answer? A study into usability of search engines , 2007 .

[9]  Rajneesh Talwar,et al.  A fast and effective image retrieval scheme using color-, texture-, and shape-based histograms , 2016, Multimedia Tools and Applications.

[10]  Y. Bitirim,et al.  An Evaluation of Major Image Search Engines on Various Query Topics , 2008, 2008 The Third International Conference on Internet Monitoring and Protection.

[11]  Burak Tokgöz,et al.  AN EVALUATION OF TURKISH RETRIEVAL PERFORMANCE OF POPULAR SEARCH ENGINES FOR INTERNET AND IMAGE SEARCH BY USING COMMON LISTS , 2013, DICTAP 2013.

[12]  Dirk Lewandowski,et al.  The Retrieval Effectiveness of Web Search Engines: Considering Results Descriptions , 2008, J. Documentation.

[13]  Yaghoub Norouzi,et al.  Image search and retrieval problems in web search engines: A case study of Persian language writing style challenges , 2018, Online Inf. Rev..

[14]  C.-C. Jay Kuo,et al.  Measuring and Predicting Tag Importance for Image Retrieval , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  James Z. Wang SIMPLIcity: a region-based retrieval system for picture libraries and biomedical image databases , 2000, MM 2000.

[16]  Zhuming Bi,et al.  A new approach for image databases design , 2017, Inf. Technol. Manag..

[17]  S. M. Shafi,et al.  Precision and Recall of Five Search Engines for Retrieval of Scholarly Information in the Field of Biotechnology , 2005, Webology.

[18]  Joachim Griesbaum,et al.  Evaluation of three German search engines: Altavista.de, Google.de and Lycos.de , 2004, Inf. Res..

[19]  Shikha Agrawal,et al.  A Survey of Feature Extraction for Content-Based Image Retrieval System , 2018 .

[20]  Longzhuang Li,et al.  Precision Evaluation of Search Engines , 2004, World Wide Web.

[21]  Amanda Spink,et al.  Real life, real users, and real needs: a study and analysis of user queries on the web , 2000, Inf. Process. Manag..

[22]  Dirk Lewandowski,et al.  Evaluating the retrieval effectiveness of web search engines using a representative query sample , 2014, J. Assoc. Inf. Sci. Technol..

[23]  Masashi Inoue,et al.  Image retrieval: Research and use in the information explosion , 2009 .

[24]  Ahmet Uyar,et al.  Investigation of the accuracy of search engine hit counts , 2009, J. Inf. Sci..

[25]  Ahmet Uyar,et al.  Investigating the precision of Web image search engines for popular and less popular entities , 2017, J. Inf. Sci..

[26]  Sumeer Gul,et al.  Search engine effectiveness using query classification: a study , 2016, Online Inf. Rev..

[27]  Mark Sanderson,et al.  Test Collection Based Evaluation of Information Retrieval Systems , 2010, Found. Trends Inf. Retr..

[28]  Dirk Lewandowski,et al.  What Users See - Structures in Search Engine Results Pages , 2009, Inf. Sci..

[29]  Yen-Wei Chen,et al.  Generic and Specific Impressions Estimation and Their Application to KANSEI-Based Clothing Fabric Image Retrieval , 2018, Int. J. Pattern Recognit. Artif. Intell..

[30]  Jean Tague-Sutcliffe,et al.  The Pragmatics of Information Retrieval Experimentation Revisited , 1997, Inf. Process. Manag..

[31]  K. R. Mulla,et al.  Search by Image: A Novel Approach to Content Based Image Retrieval System , 2016 .

[32]  Michael D. Gordon,et al.  Finding Information on the World Wide Web: The Retrieval Effectiveness of Search Engines , 1999, Inf. Process. Manag..

[33]  Leo Egghe,et al.  a Measure for the Cohesion of Weighted Networks , 2003, J. Assoc. Inf. Sci. Technol..

[34]  Sara Shatford,et al.  Analyzing the Subject of a Picture: A Theoretical Approach , 1986 .

[35]  Hao-hua Chu,et al.  Search En-gines for the World Wide Web: A Compara-tive Study and Evaluation Methodology , 1996 .

[36]  Judith Wusteman,et al.  Putting Google Scholar to the test: a preliminary study , 2007, Program.

[37]  Phani Kidambi,et al.  Benchmarking Web-Based Image Retrieval , 2010, AMCIS.

[38]  Rabia Nuray-Turan,et al.  Automatic performance evaluation of Web search engines , 2004, Inf. Process. Manag..

[39]  Gyu Sang Choi,et al.  Evaluating Retrieval Effectiveness by Sustainable Rank List , 2017 .