Supporting the Modern Polyglot: A Comparison of Multilingual Search Interfaces

The unrelenting rise in online user diversification has generated tremendous new challenges for search system providers. Among these, the need to address multiple user language abilities and preferences is paramount. The majority of research on multilingual search has so far focused on improving retrieval and translation techniques in cross-language information retrieval. However, less research has focused on the human-computer interaction aspects of multilingual search, particularly in terms of multilingual result display interfaces. To address this research gap, this paper presents a comparison of 5 different search interface designs for multilingual search. We analyze and evaluate these interfaces through a crowd-based experiment involving 885 participants. Our results show that the common approach of interleaving multilingual results is in fact the least preferred, whereas single-page displays with clear language separation are most preferred. In addition, we show that user proficiency and search content type play an important role in user preferences, and that different interfaces elicit different user behaviors.

[1]  Carol Peters,et al.  CLEF 2008: Ad Hoc Track Overview , 2008, CLEF.

[2]  Katharina Reinecke,et al.  Quantifying visual preferences around the world , 2014, CHI.

[3]  David Firth,et al.  Bradley-Terry Models in R: The BradleyTerry2 Package , 2012 .

[4]  Robert Villa,et al.  Factors affecting click-through behavior in aggregated search interfaces , 2010, CIKM.

[5]  Jianqiang Wang,et al.  User-assisted query translation for interactive cross-language information retrieval , 2008, Inf. Process. Manag..

[6]  Martin Braschler Combination Approaches for Multilingual Text Retrieval , 2004, Information Retrieval.

[7]  Paul D. Clough,et al.  Providing Multilingual Access to FLICKR for Arabic Users , 2006, CLEF.

[8]  Carol Peters,et al.  Multilingual Information Retrieval , 2012, Springer Berlin Heidelberg.

[9]  Maarten de Rijke,et al.  Aggregated search interface preferences in multi-session search tasks , 2013, SIGIR.

[10]  Paul Thomas,et al.  Evaluating interfaces for government metasearch , 2010, IIiX.

[11]  Vincent P. Wade,et al.  Towards Personalized Multilingual Information Access - Exploring the Browsing and Search Behavior of Multilingual Users , 2014, UMAP.

[12]  Emine Yilmaz,et al.  Crowdsourcing interactions: using crowdsourcing for evaluating interactive information retrieval systems , 2012, Information Retrieval.

[13]  Spike Cramphorn Blink: The Power of Thinking without Thinking / Strangers to Ourselves: Discovering the Adaptive Unconscious , 2006, Journal of Advertising Research.

[14]  Ralph A. Bradley,et al.  14 Paired comparisons: Some basic procedures and examples , 1984, Nonparametric Methods.

[15]  Carol Peters,et al.  The MultiMatch Prototype: Multilingual/Multimedia Search for Cultural Heritage Objects , 2008, ECDL.

[16]  Hans Uszkoreit,et al.  A system for supporting cross-lingual information retrieval , 2000, Inf. Process. Manag..

[17]  Pia Borlund,et al.  The IIR evaluation model: a framework for evaluation of interactive information retrieval systems , 2003, Inf. Res..

[18]  Daniela Petrelli,et al.  Which user interaction for cross-language information retrieval? Design issues and reflections , 2006, J. Assoc. Inf. Sci. Technol..

[19]  Julio Gonzalo,et al.  FlickLing: a Multilingual Search Interface for Flickr , 2008, CLEF.

[20]  Jennifer Marlow,et al.  Exploring the Effects of Language Skills on Multilingual Web Search , 2008, ECIR.