A Novel Algorithm for Improving the ESP Game

one of the human-computation techniques is games with a purpose (GWAP) and microtask crowdsourcing. These techniques can help in making the image retrieval (IR) be more accurate and helpful. It provides the IR system’s database with a rich of information by adding more descriptions and annotations to images. One of the systems of human-computation is ESP Game. ESP Game is a type of games with a purpose. In the ESP game there has been a lot of work was proposed to solve many of the problems in it and make the most benefit of the game. One of these problems is that the ESP game neglects player's answers for the same image that don't match. This paper presents a new algorithm to use neglected data to generate new labels for the images. We deploy our algorithm at the University of Menoufia for evaluation. In this trial, we first focused on measuring the total number of labels generated by our Recycle Unused Answers For Images algorithm (RUAI). In our evaluation of the RUAI algorithm we present a new evaluation measure we called it quality of labels measure. This measure identifies the quality of the labels in compared to the pre-qualified labels. The results reveal that the proposed algorithm improved the results in compared to the ESP game in all cases.

[1]  Mark S. Ackerman,et al.  Questions in, knowledge in?: a study of naver's question answering community , 2009, CHI.

[2]  Jane Yung-jen Hsu,et al.  KissKissBan: a competitive human computation game for image annotation , 2010, HCOMP '09.

[3]  Elena Paslaru Bontas Simperl,et al.  An Experiment in Comparing Human-Computation Techniques , 2012, IEEE Internet Computing.

[4]  Padmini Srinivasan,et al.  Comparing Crowd-Based, Game-Based, and Machine-Based Approaches in Initial Query and Query Refinement Tasks , 2013, ECIR.

[5]  C. Papadimitriou,et al.  A Game-Theoretic Analysis of Games with a Purpose , 2008 .

[6]  Kuan-Ta Chen,et al.  The design of puzzle selection strategies for GWAP systems , 2010, Concurr. Comput. Pract. Exp..

[7]  Laura A. Dabbish,et al.  Designing games with a purpose , 2008, CACM.

[8]  David A. Forsyth,et al.  Matching Words and Pictures , 2003, J. Mach. Learn. Res..

[9]  Laura A. Dabbish,et al.  Labeling images with a computer game , 2004, AAAI Spring Symposium: Knowledge Collection from Volunteer Contributors.

[10]  Richard E. Ladner,et al.  WebInSight:: making web images accessible , 2006, Assets '06.

[11]  Irwin King,et al.  A Survey of Human Computation Systems , 2009, 2009 International Conference on Computational Science and Engineering.

[12]  Stephen E. Robertson,et al.  Rethinking the ESP game , 2009, CHI Extended Abstracts.