Leveraging Collaboration: A Methodology for the Design of Social Problem-Solving Systems

Social collaboration has been shown to facilitate problemsolving activity in diverse sets of environments. Nevertheless, if not well designed, social and human computation systems may achieve results only similar to those of a single human subject performing a task. This scenario reflects a need for better understanding of the performance issues of human problem-solving social networks. Firstly, we propose a model for simulating social problem-solving. We then carry out several simulations with artificial agents supported by results of experiments carried out with human subjects, in order to analyse which parameters influence the performance of collaborative problem-solving social networks. We analyse the strategies humans follow when solving a problem, comparing them with alternative ones, and identify the consequences of the employed strategies in the collective performance of the social network. Our results also indicate that copying and guessing are beneficial to the performance of the social networks. We then propose mechanisms that can improve collaborative problem-solving. Finally, we show that our results lead to a methodology for the design of efficient problem-solving systems that can be applied to several kinds of collaborative social systems.

[1]  B A Huberman,et al.  Cooperative Solution of Constraint Satisfaction Problems , 1991, Science.

[2]  Laura A. Dabbish,et al.  Designing games with a purpose , 2008, CACM.

[3]  A. Pentland,et al.  Computational Social Science , 2009, Science.

[4]  E. S. Pearson,et al.  Tests for departure from normality: Comparison of powers , 1977 .

[5]  Mark Newman,et al.  Networks: An Introduction , 2010 .

[6]  Jon M. Kleinberg,et al.  Networks, Crowds, and Markets: Reasoning about a Highly Connected World [Book Review] , 2013, IEEE Technol. Soc. Mag..

[7]  Daniel A. Levinthal,et al.  Exploration and Exploitation in Organizational Learning , 2007 .

[8]  Yiftach Nagar,et al.  Making Business Predictions by Combining Human and Machine Intelligence in Prediction Markets , 2011, ICIS.

[9]  Winter A. Mason,et al.  Collaborative learning in networks , 2011, Proceedings of the National Academy of Sciences.

[10]  Michael Kearns,et al.  Experiments in social computation , 2012, KDD.

[11]  D. Meyer,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S6 References Evidence for a Collective Intelligence Factor in the Performance of Human Groups , 2022 .

[12]  M. Nowak.  Five Rules for the Evolution of Cooperation , 2006, Science.

[13]  Sandip Sen,et al.  Social Instruments for Robust Convention Emergence , 2011, IJCAI.

[14]  Mark Klein,et al.  Programming the global brain , 2012, Commun. ACM.

[15]  Luis von Ahn,et al.  Human computation , 2009, 2009 46th ACM/IEEE Design Automation Conference.

[16]  David Baker,et al.  Algorithm discovery by protein folding game players , 2011, Proceedings of the National Academy of Sciences.

[17]  Allen Newell,et al.  Report on a general problem-solving program , 1959, IFIP Congress.

[18]  H. Simon,et al.  Invariants of human behavior. , 1990, Annual review of psychology.

[19]  Albert-Laszlo Barabasi,et al.  Deterministic scale-free networks , 2001 .

[20]  Luís C. Lamb,et al.  Collaboration Emergence in Social Networks with Informational Natural Selection , 2011, 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing.

[21]  A. Church.  Review: A. M. Turing, On Computable Numbers, with an Application to the Entscheidungsproblem , 1937 .

[22]  Luís C. Lamb,et al.  Memetic Networks: Analyzing the Effects of Network Properties in Multi-Agent Performance , 2008, AAAI.

[23]  Bertram Felgenhauer,et al.  Mathematics of Sudoku I , 2006 .

[24]  R. Dawkins.  The Blind Watchmaker , 1986 .

[25]  A. Turing.  On Computable Numbers, with an Application to the Entscheidungsproblem. , 1937 .

[26]  E. David,et al.  Networks, Crowds, and Markets: Reasoning about a Highly Connected World , 2010 .

[27]  Tad Hogg,et al.  Solving the Organizational Free Riding Problem with Social Networks , 2008, AAAI Spring Symposium: Social Information Processing.

[28]  Mark Lubell,et al.  Conformists and mavericks: the empirics of frequency-dependent cultural transmission , 2008 .

[29]  Andrea Montanari,et al.  The spread of innovations in social networks , 2010, Proceedings of the National Academy of Sciences.

[30]  H. Roche,et al.  Why Copy Others? Insights from the Social Learning Strategies Tournament , 2010 .