Research Directions for Pushing Harnessing Human Computation to Mainstream Video Games

In this paper, we propose a research direction that will allow the harnessing of human computation to be included in mainstream video games. Human computing resources are vastly different and superior in some cases compared to traditional computing machines. Previous findings in this domain showed that humans playing FoldIt, a protein folding video game, created new solutions to the problem that were previously unknown. Successes like these suggest that harnessing human computation through games can provide the world with a new computation resource, but existing games in this domain tend to be built around the problem. This means a large population of game players remains unharnessed. We, however, hypothesize that focusing research efforts on the synergy of understanding isomorphing problems, identifying problem solving behavior in mainstream video games, and an understanding of real-world problems is a direction that will allow us to merge harnessing human computation into these mainstream games.

[1]  Henry Lieberman,et al.  An interface for targeted collection of common sense knowledge using a mixture model , 2009, IUI.

[2]  Wayne Luk,et al.  Harnessing Human Computation Cycles for the FPGA Placement Problem , 2009, ERSA.

[3]  David Baker,et al.  Algorithm discovery by protein folding game players , 2011, Proceedings of the National Academy of Sciences.

[4]  Manuel Blum,et al.  Improving Image Search with PHETCH , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[5]  Filippo Menczer,et al.  GiveALink tagging game: an incentive for social annotation , 2010, HCOMP '10.

[6]  Jennifer Golbeck,et al.  Curator: a game with a purpose for collection recommendation , 2010, CHI.

[7]  David Maxwell Chickering,et al.  Intentions: a game for classifying search query intent , 2009, CHI Extended Abstracts.

[8]  P. N. Suganthan,et al.  Problem Definitions and Evaluation Criteria for CEC 2011 Competition on Testing Evolutionary Algorithms on Real World Optimization Problems , 2011 .

[9]  Flaminia L. Luccio,et al.  Fun with Algorithms , 2012, Lecture Notes in Computer Science.

[10]  Sébastien Bubeck,et al.  Convex Optimization: Algorithms and Complexity , 2014, Found. Trends Mach. Learn..

[11]  Matthew Chalmers,et al.  EyeSpy: supporting navigation through play , 2009, CHI.

[12]  Gert R. G. Lanckriet,et al.  A Game-Based Approach for Collecting Semantic Annotations of Music , 2007, ISMIR.

[13]  Jeff Yan,et al.  Streamlining Attacks on CAPTCHAs with a Computer Game , 2009, IJCAI.

[14]  Ellen Yi-Luen Do,et al.  Games for sketch data collection , 2009, SBIM '09.

[15]  Martin Hepp,et al.  OntoGame: Towards Overcoming the Incentive Bottleneck in Ontology Building , 2007, OTM Workshops.

[16]  Jane Yung-jen Hsu,et al.  PhotoSlap: A Multi-player Online Game for Semantic Annotation , 2007, AAAI.

[17]  Laura A. Dabbish,et al.  Designing games with a purpose , 2008, CACM.

[18]  Edith Law,et al.  Input-agreement: a new mechanism for collecting data using human computation games , 2009, CHI.

[19]  D. Wolpert,et al.  No Free Lunch Theorems for Search , 1995 .

[20]  Peter A. Dinda,et al.  Experiences with scheduling and mapping games for adaptive distributed systems: summary , 2009, ICAC '09.

[21]  Christoph Schlieder,et al.  Designing location-based mobile games with a purpose: collecting geospatial data with CityExplorer , 2008, ACE '08.

[22]  Hongbin Wang,et al.  Isomorphic representations lead to the discovery of different forms of a common strategy with different degrees of generality , 1998 .

[23]  Aneta Takhtamysheva,et al.  Frontiers of a paradigm: exploring human computation with digital games , 2010, HCOMP '10.

[24]  Michael S. Bernstein,et al.  Collabio: a game for annotating people within social networks , 2009, UIST '09.

[25]  Herbert A Simon,et al.  The understanding process: Problem isomorphs , 1976, Cognitive Psychology.

[26]  Raman Chandrasekar,et al.  Improving search engines using human computation games , 2009, CIKM.

[27]  Udo Kruschwitz,et al.  Addressing the Resource Bottleneck to Create Large-Scale Annotated Texts , 2008, STEP.

[28]  Nicolas de Condorcet Essai Sur L'Application de L'Analyse a la Probabilite Des Decisions Rendues a la Pluralite Des Voix , 2009 .

[29]  Jirí Mírovský,et al.  Play the Language: Play Coreference , 2009, ACL.

[30]  Jane Yung-jen Hsu,et al.  KissKissBan: a competitive human computation game for image annotation , 2010, HCOMP '09.

[31]  Daniel P. W. Ellis,et al.  Please Scroll down for Article Journal of New Music Research a Web-based Game for Collecting Music Metadata a Web-based Game for Collecting Music Metadata , 2022 .

[32]  Mark Steyvers,et al.  Identifying Emotions, Intentions, and Attitudes in Text Using a Game with a Purpose , 2010, HLT-NAACL 2010.

[33]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[34]  Manuel Blum,et al.  Verbosity: a game for collecting common-sense facts , 2006, CHI.

[35]  H. Lieberman Common Consensus : a web-based game for collecting commonsense goals , 2007 .

[36]  Jiajie Zhang,et al.  Representations in Distributed Cognitive Tasks , 1994, Cogn. Sci..

[37]  Raymond D. Sauer,et al.  The Economics of Wagering Markets , 1998 .

[38]  Michael J. Muller,et al.  The dogear game: a social bookmark recommender system , 2007, GROUP.

[39]  Raman Chandrasekar,et al.  Page hunt: improving search engines using human computation games , 2009, SIGIR.

[40]  David Maxwell Chickering,et al.  Learning consensus opinion: mining data from a labeling game , 2009, WWW '09.

[41]  Brandon G. Morton,et al.  Improving music emotion labeling using human computation , 2010, HCOMP '10.

[42]  Bei Yu,et al.  Sentence recall game: a novel tool for collecting data to discover language usage patterns , 2010, HCOMP '10.

[43]  Gert R. G. Lanckriet,et al.  User-centered design of a social game to tag music , 2009, HCOMP '09.

[44]  Jeff Yan,et al.  Magic Bullet: a dual-purpose computer game , 2009, HCOMP '09.

[45]  Praveen Paritosh,et al.  The anatomy of a large-scale human computation engine , 2010, HCOMP '10.

[46]  John Urquhart Ferguson Mutually reinforcing systems , 2010, HCOMP '10.

[47]  Hidir Aras,et al.  Playful tagging: folksonomy generation using online games , 2009, WWW '09.

[48]  Irfan A. Essa,et al.  Audio Puzzler: piecing together time-stamped speech transcripts with a puzzle game , 2008, ACM Multimedia.

[49]  David P. Anderson,et al.  A new major SETI project based on Project Serendip data and 100 , 1997 .

[50]  Christian Blum,et al.  Metaheuristics in combinatorial optimization: Overview and conceptual comparison , 2003, CSUR.

[51]  Erik Brynjolfsson,et al.  Race against the machine : how the digital revolution is accelerating innovation, driving productivity, and irreversibly transforming employment and the economy , 2011 .

[52]  Roger B. Dannenberg,et al.  TagATune: A Game for Music and Sound Annotation , 2007, ISMIR.

[53]  Luis von Ahn,et al.  Matchin: eliciting user preferences with an online game , 2009, CHI.

[54]  Arno Scharl,et al.  A web-based user interaction framework for collaboratively building and validating ontologies , 2008, IHC.

[55]  Manuel Blum,et al.  Peekaboom: a game for locating objects in images , 2006, CHI.

[56]  Johanna D. Moore,et al.  Report on the First NLG Challenge on Generating Instructions in Virtual Environments (GIVE) , 2009, ENLG.

[57]  Arno Scharl,et al.  Games with a purpose for social networking platforms , 2009, HT '09.

[58]  Erik D. Demaine,et al.  Classic Nintendo Games are (NP-)Hard , 2012, ArXiv.

[59]  Zoran Popovic,et al.  Reconstructing the world in 3D: bringing games with a purpose outdoors , 2010, FDG.

[60]  David A. Shamma,et al.  Teaching a Music Search Engine Through Play , 2007, CHI 2007.

[61]  J. Davitz,et al.  A survey of studies contrasting the quality of group performance and individual performance, 1920-1957. , 1958, Psychological bulletin.

[62]  Manuel Blum,et al.  Improving accessibility of the web with a computer game , 2006, CHI.

[63]  Udo Kruschwitz,et al.  Phrase Detectives: A Web-based collaborative annotation game , 2008 .

[64]  Gabriella Kazai,et al.  Towards methods for the collective gathering and quality control of relevance assessments , 2009, SIGIR.

[65]  Timothy Chklovski,et al.  Collecting paraphrase corpora from volunteer contributors , 2005, K-CAP '05.

[66]  Jane Yung-jen Hsu,et al.  Community-based game design: experiments on social games for commonsense data collection , 2009, HCOMP '09.

[67]  Tiago Borges Coelho,et al.  OutRandom: addressing an underrated skill , 2010, Fun and Games '10.

[68]  Nuno Correia,et al.  A gesture based game for image tagging , 2008, CHI Extended Abstracts.

[69]  Tom M. Mitchell,et al.  Search war: a game for improving web search , 2009, HCOMP '09.

[70]  Takahiro Hara,et al.  A game based approach to assign geographical relevance to web images , 2009, WWW '09.

[71]  David Salesin,et al.  The challenge of designing scientific discovery games , 2010, FDG.

[72]  David A. Shamma,et al.  Karaoke callout: using social and collaborative cell phone networking for new entertainment modalities and data collection , 2006, AMCMM '06.

[73]  Luis von Ahn Games with a Purpose , 2006, Computer.

[74]  Michael Vitale,et al.  The Wisdom of Crowds , 2015, Cell.

[75]  Valeria Bertacco,et al.  Human computing for EDA , 2009, 2009 46th ACM/IEEE Design Automation Conference.

[76]  C. Sunstein Infotopia: How Many Minds Produce Knowledge , 2006 .

[77]  Sebastian Matyas,et al.  Playful Geospatial Data Acquisition by Location-based Gaming Communities , 2007, Int. J. Virtual Real..

[78]  Martin Hepp,et al.  Games with a Purpose for the Semantic Web , 2008, IEEE Intelligent Systems.

[79]  Giovanni Viglietta Gaming Is a Hard Job, but Someone Has to Do It! , 2013, Theory of Computing Systems.

[80]  Youngmoo E. Kim,et al.  MoodSwings: A Collaborative Game for Music Mood Label Collection , 2008, ISMIR.

[81]  Adrien Treuille,et al.  Predicting protein structures with a multiplayer online game , 2010, Nature.

[82]  Luis von Ahn,et al.  Word sense disambiguation via human computation , 2010, HCOMP '10.

[83]  Ebroul Izquierdo,et al.  An interactive framework for image annotation through gaming , 2010, MIR '10.