论文信息 - Overview of the TREC 2012 Crowdsourcing Track

Overview of the TREC 2012 Crowdsourcing Track

Abstract : In 2012, the Crowdsourcing track had two separate tasks: a text relevance assessing task (TRAT) and an image relevance assessing task (IRAT). This track overview describes the track and provides analysis of the track's results.

[1] Donna K. Harman,et al. Overview of the Eighth Text REtrieval Conference (TREC-8) , 1999, TREC.

[2] Zhi Xu,et al. York University at TREC 2012: CrowdSourcing Track , 2012, TREC.

[3] Mark Sanderson,et al. Diversity in Photo Retrieval: Overview of the ImageCLEFPhoto Task 2009 , 2009, CLEF.

[4] Javed A. Aslam,et al. Northeastern University Runs at the TREC12 Crowdsourcing Track , 2012, TREC.

[5] Douglas W. Oard,et al. Overview of the TREC 2009 Legal Track , 2009, TREC.

[6] Gordon V. Cormack,et al. TREC 2006 Spam Track Overview , 2006, TREC.

[7] Chuang Zhang,et al. BUPT_PRIS at TREC 2012 Crowdsourcing Track 1 , 2012, TREC.

[8] Laura A. Dabbish,et al. Labeling images with a computer game , 2004, AAAI Spring Symposium: Knowledge Collection from Volunteer Contributors.

[9] Steven Reece,et al. Using a Bayesian Model to Combine LDA Features with Crowdsourced Responses , 2012, TREC.

[10] Padmini Srinivasan,et al. Using Hybrid Methods for Relevance Assessment in TREC Crowd '12 , 2012, TREC.

[11] Bart Thomee,et al. Overview of the ImageCLEF 2012 Flickr Photo Annotation and Retrieval Task , 2012, CLEF.

[12] Prateek Singhal,et al. Skierarchy: Extending the Power of Crowdsourcing Using a Hierarchy of Domain Experts, Crowd and Machine Learning , 2012, TREC.