Evaluating Mobile Proactive Context-Aware Retrieval: An Incremental Benchmark

We present the evaluation of a novel application for Web content perusal by means of context-aware mobile devices that proactively query an external search engine. To this aim, we develop a TREC-like benchmark and we use it to evaluate different strategies for automatic query construction on the basis of user's current context. We discuss both the methodology and the results.

[1]  Paolo Coppola,et al.  AI Techniques in a Context-Aware Ubiquitous Environment , 2010, Pervasive Computing, Innovations in Intelligent Multimedia and Applications.

[2]  Hani Hagras,et al.  Pervasive Computing, Innovations in Intelligent Multimedia and Applications , 2010, Computer Communications and Networks.

[3]  Gareth J. F. Jones,et al.  Context-Aware Retrieval for Ubiquitous Computing Environments , 2003, Mobile HCI Workshop on Mobile and Ubiquitous Information Access.

[4]  J. R. Freer.  Computer Communications and Networks , 1988 .

[5]  Fabio Crestani,et al.  Spoken versus written queries for mobile information access , 2004 .

[6]  Stefano Mizzaro,et al.  Retrieval of context-aware applications on mobile devices: how to evaluate? , 2008, IIiX.

[7]  Charles L. A. Clarke,et al.  Efficient construction of large test collections , 1998, SIGIR '98.

[8]  Ayse Göker,et al.  Evaluation of a mobile information system in context , 2008, Inf. Process. Manag..