Towards Nuanced System Evaluation Based on Implicit User Expectations
暂无分享,去创建一个
Peter Bailey | Alistair Moffat | Falk Scholer | Paul Thomas | P. Bailey | Paul Thomas | Alistair Moffat | Falk Scholer
[1] Chris Buckley,et al. The TREC-8 Query Track , 1999, TREC.
[2] Tony Ward,et al. The roar of the crowd , 2009 .
[3] and software — performance evaluation , .
[4] Peter Bailey,et al. Understanding the relationship of information need specificity to search query length , 2007, SIGIR.
[5] Wei Chu,et al. Modeling the impact of short- and long-term behavior on search personalization , 2012, SIGIR '12.
[6] Gregory N. Hullender,et al. Learning to rank using gradient descent , 2005, ICML.
[7] Nicholas J. Belkin,et al. Validation of a model of information seeking over multiple search sessions , 2005, J. Assoc. Inf. Sci. Technol..
[8] Jaime Arguello,et al. Grannies, tanning beds, tattoos and NASCAR: evaluation of search tasks with varying levels of cognitive complexity , 2012, IIiX.
[9] Gabriella Kazai,et al. Overview of the TREC 2012 Crowdsourcing Track , 2012, TREC.
[10] Jaana Kekäläinen,et al. Cumulated gain-based evaluation of IR techniques , 2002, TOIS.
[11] Alistair Moffat,et al. Rank-biased precision for measurement of retrieval effectiveness , 2008, TOIS.
[12] Eero Sormunen,et al. Liberal relevance criteria of TREC -: counting on negligible documents? , 2002, SIGIR '02.
[13] Alistair Moffat,et al. What Users Do: The Eyes Have It , 2013, AIRS.
[14] Thorsten Joachims,et al. Accurately Interpreting Clickthrough Data as Implicit Feedback , 2017 .
[15] Olivier Chapelle,et al. Expected reciprocal rank for graded relevance , 2009, CIKM.
[16] Alistair Moffat,et al. Users versus models: what observation tells us about effectiveness metrics , 2013, CIKM.
[17] H. Akaike. A new look at the statistical model identification , 1974 .
[18] Charles L. A. Clarke,et al. Time-based calibration of effectiveness measures , 2012, SIGIR '12.
[19] Peter Bailey,et al. User Variability and IR System Evaluation , 2015, SIGIR.
[20] Jaime Arguello,et al. Development and Evaluation of Search Tasks for IIR Experiments using a Cognitive Complexity Framework , 2015, ICTIR.
[21] Susan T. Dumais,et al. To personalize or not to personalize: modeling queries with variation in user intent , 2008, SIGIR '08.
[22] Benjamin S. Bloom,et al. A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .