Balancing Human and Machine Contributions in Human Computation Systems

Many interesting and successful human computation systems leverage the complementary computational strengths of both humans and machines to solve these problems. In this chapter, we examine Human Computation as a type of Human-Computer Collaboration—collaboration involving at least one human and at least one computational agent. We discuss recent advances in the open area of function allocation, and explore how to balance the contributions of humans and machines in computational systems. We then explore how human-computer collaborative strategies can be used to solve problems that are difficult or computationally infeasible for computers or humans alone.

[1]  Edith Law,et al.  Input-agreement: a new mechanism for collecting data using human computation games , 2009, CHI.

[2]  Thomas B. Sheridan,et al.  Function allocation: algorithm, alchemy or apostasy? , 2000, Int. J. Hum. Comput. Stud..

[3]  Dafna Shahaf,et al.  Towards a Theory of AI Completeness , 2007, AAAI Spring Symposium: Logical Formalizations of Commonsense Reasoning.

[4]  W. Lewis Johnson,et al.  Animated Agents for Procedural Training in Virtual Reality: Perception, Cognition, and Motor Control , 1999, Appl. Artif. Intell..

[5]  Sidney W. A. Dekker,et al.  MABA-MABA or Abracadabra? Progress on Human–Automation Co-ordination , 2002, Cognition, Technology & Work.

[6]  Kristin A. Cook,et al.  Illuminating the Path: The Research and Development Agenda for Visual Analytics , 2005 .

[7]  S S Stevens,et al.  HUMAN ENGINEERING FOR AN EFFECTIVE AIR-NAVIGATION AND TRAFFIC-CONTROL SYSTEM, AND APPENDIXES 1 THRU 3 , 1951 .

[8]  Nenghai Yu,et al.  A comprehensive human computation framework: with application to image labeling , 2008, ACM Multimedia.

[9]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[10]  J. J. Gibson.  The theory of affordances , 1977 .

[11]  James F. Allen,et al.  TRIPS: An Integrated Intelligent Problem-Solving Assistant , 1998, AAAI/IAAI.

[12]  Irwin King,et al.  Mathematical Modeling of Social Games , 2009, 2009 International Conference on Computational Science and Engineering.

[13]  Harold E. Price,et al.  The Allocation of Functions in Systems , 1985 .

[14]  三嶋 博之.  The theory of affordances , 2008 .

[15]  R. Jordan Crouser,et al.  Online Submission ID: 200 An Affordance-Based Framework for Human Computation and Human-Computer Collaboration , 2022 .

[16]  N. Jordan.  Allocation of functions between man and machines in automated systems. , 1963 .

[17]  Loren G. Terveen,et al.  Overview of human-computer collaboration , 1995, Knowl. Based Syst..

[18]  Raúl E. Valdés-Pérez,et al.  Principles of Human Computer Collaboration for Knowledge Discovery in Science , 1999, Artif. Intell..

[19]  Denis Lalanne,et al.  Investigating and reflecting on the integration of automatic data analysis and visualization in knowledge discovery , 2010, SKDD.