Common Consensus : a web-based game for collecting commonsense goals

In our research on Commonsense reasoning, we have found that an especially important kind of knowledge is knowledge about human goals. Especially when applying Commonsense reasoning to interface agents, we need to recognize goals from user actions (plan recognition), and generate sequences of actions that implement goals (planning). We also often need to answer more general questions about the situations in which goals occur, such as when and where a particular goal might be likely, or how long it is likely to take to achieve. In past work on Commonsense knowledge acquisition, users have been directly asked for such information. Recently, however, another approach has emerged—to entice users into playing games where supplying the knowledge is the means to scoring well in the game, thus motivating the players. This approach has been pioneered by Luis von Ahn and his colleagues, who refer to it as Human Computation. Common Consensus is a fun, self-sustaining web-based game, that both collects and validates Commonsense knowledge about everyday goals. It is based on the structure of the TV game show Family Feud1. A small user study showed that users find the game fun, knowledge quality is very good, and the rate of knowledge collection is rapid. ACM Classification: H.3.3 [INFORMATION STORAGE AND RETRIEVAL]: Information Search and Retrieval; I.2.6 [ARTIFICIAL INTELLIGENCE]: Learning

[1]  E. Rosch,et al.  Categorization of Natural Objects , 1981 .

[2]  Anand S. Rao,et al.  BDI Agents: From Theory to Practice , 1995, ICMAS.

[3]  Douglas B. Lenat,et al.  CYC: a large-scale investment in knowledge infrastructure , 1995, CACM.

[4]  Lucy Vanderwende,et al.  MindNet: Acquiring and Structuring Semantic Information from Text , 1998, COLING-ACL.

[5]  Yolanda Gil,et al.  An integrated environment for knowledge acquisition , 2001, IUI '01.

[6]  Push Singh,et al.  The Public Acquisition of Commonsense Knowledge , 2002 .

[7]  Henry Lieberman,et al.  Beating Common Sense into Interactive Applications , 2004, AI Mag..

[8]  Rakesh Gupta,et al.  Common Sense Data Acquisition for Indoor Mobile Robots , 2004, AAAI.

[9]  Hugo Liu,et al.  Commonsense Reasoning in and Over Natural Language , 2004, KES.

[10]  Chris Quirk,et al.  Unsupervised Construction of Large Paraphrase Corpora: Exploiting Massively Parallel News Sources , 2004, COLING.

[11]  Laura A. Dabbish,et al.  Labeling images with a computer game , 2004, AAAI Spring Symposium: Knowledge Collection from Volunteer Contributors.

[12]  Joshua B. Tenenbaum,et al.  Bayesian models of human action understanding , 2005, NIPS.

[13]  Yolanda Gil,et al.  Improving the design of intelligent acquisition interfaces for collecting world knowledge from web contributors , 2005, K-CAP '05.

[14]  Ian Scott Eslick,et al.  Searching for commonsense , 2006 .

[15]  Henry Lieberman,et al.  A goal-oriented interface to consumer electronics using planning and commonsense reasoning , 2006, IUI '06.

[16]  Henry Lieberman,et al.  A goal-oriented Web browser 4 , 2006 .

[17]  Manuel Blum,et al.  Verbosity: a game for collecting common-sense facts , 2006, CHI.

[18]  Manuel Blum,et al.  Peekaboom: a game for locating objects in images , 2006, CHI.