Web retrieval systems and the Greek language: do they have an understanding?

Searching the web is a common activity of web users. English and non-English speakers utilize international or local search engines so as to satisfy their information needs. Most of the attempts at evaluation of search engines focus on English queries and on English document collections. In this paper an evaluation methodology is presented and the capabilities of international and local web retrieval systems using Greek queries are evaluated based on this method. We aim at identifying difficulties and knowledge requirements when using a Greek supporting search engine. The importance of interface localization and the effects of standard information retrieval techniques such as case insensitivity, stopword removal and simple stemming are studied in international and local search engines. The evaluation methodology is applicable to other non-English natural languages as well.

[1]  Amanda Spink,et al.  An analysis of Web searching by European AlltheWeb.com users , 2005, Inf. Process. Manag..

[2]  Hong Cui,et al.  How Do Search Engines Handle Chinese Queries? , 2005, Webology.

[3]  Gang Wang,et al.  Internet searching and browsing in a multilingual world: An experiment on the Chinese Business Intelligence Portal (CBizPort) , 2004, J. Assoc. Inf. Sci. Technol..

[4]  Jacek Gwizdka,et al.  Towards Information Retrieval Measures for Evaluation of Web Search Engines , 1999 .

[5]  T. Kalamboukis.  Suffix stripping with modern Greek , 1995 .

[6]  Marek Sroka.  Web Search Engines for Polish Information Retrieval: Questions of Search Capabilities and Retrieval Performance , 2000 .

[7]  Song Han,et al.  Automatic Identification of Chinese Stop Words , 2006 .

[8]  Stephen E. Robertson,et al.  THE PARAMETRIC DESCRIPTION OF RETRIEVAL TESTS: PART I: THE BASIC PARAMETERS , 1969 .

[9]  C N Gould,et al.  NOTES ON THE EVIDENCES OF HUMAN REMAINS FROM JACOBS CAVERN. , 1903, Science.

[10]  Pia Borlund,et al.  Experimental components for the evaluation of interactive information retrieval systems , 2000, J. Documentation.

[11]  Judit Bar-Ilan,et al.  How do search engines respond to some non-English queries? , 2005, J. Inf. Sci..

[12]  Ingrid Hsieh Yee.  The Retrieval Power of Selected Search Engines: How Well Do They Address General Reference Questions and Subject Questions? , 1998 .

[13]  Hao-hua Chu,et al.  Search En-gines for the World Wide Web: A Compara-tive Study and Evaluation Methodology , 1996 .

[14]  Fotis Lazarinis.  Evaluating the searching capabilities of e-commerce web sites in a non-English language: A Greek case study , 2007, Online Inf. Rev..

[15]  Jacques Savoy,et al.  A Stemming Procedure and Stopword List for General French Corpora , 1999, J. Am. Soc. Inf. Sci..

[16]  Cyril W. Cleverdon,et al.  Aslib Cranfield research project - Factors determining the performance of indexing systems; Volume 1, Design; Part 2, Appendices , 1966 .

[17]  Hsin-Liang Chen,et al.  Evaluation of Web-Based Search Engines from the End-User's Perspective: A Pilot Study , 1998 .

[18]  Jacques Savoy.  A stemming procedure and stopword list for general French corpora , 1999 .

[19]  Charles Oppenheim,et al.  The evaluation of WWW search engines , 2000, J. Documentation.

[20]  Michael D. Gordon,et al.  Finding Information on the World Wide Web: The Retrieval Effectiveness of Search Engines , 1999, Inf. Process. Manag..

[21]  Stephen Tomlinson.  Finnish, Portuguese and Russian Retrieval with Hummingbird SearchServer™ at CLEF 2004 , 2004, CLEF.

[22]  Mark D. Dunlop.  Time, relevance and interaction modelling for information retrieval , 1997, SIGIR '97.

[23]  SpinkAmanda,et al.  An analysis of web searching by European AlltheWeb.com users , 2005 .

[24]  Martin P. Courtois,et al.  Cool tools for searching the Web: a performance evaluation , 1995 .

[25]  Fotis Lazarinis.  Do search engines understand Greek or user requests “ sound Greek ” to them ? , 2005 .