Collective Intelligence and its Implementation on the Web: Algorithms to Develop a Collective Mental Map

Collective intelligence is defined as the ability of a group to solve more problems than its individual members. It is argued that the obstacles created by individual cognitive limits and the difficulty of coordination can be overcome by using a collective mental map (CMM). A CMM is defined as an external memory with shared read/write access, that represents problem states, actions and preferences for actions. It can be formalized as a weighted, directed graph. The creation of a network of pheromone trails by ant colonies points us to some basic mechanisms of CMM development: averaging of individual preferences, amplification of weak links by positive feedback, and integration of specialised subnetworks through division of labor. Similar mechanisms can be used to transform the World-Wide Web into a CMM, by supplementing it with weighted links. Two types of algorithms are explored: 1) the co-occurrence of links in web pages or user selections can be used to compute a matrix of link strengths, thus generalizing the technique of &201C;collaborative filtering&201D;; 2) learning web rules extract information from a user&2018;s sequential path through the web in order to change link strengths and create new links. The resulting weighted web can be used to facilitate problem-solving by suggesting related links to the user, or, more powerfully, by supporting a software agent that discovers relevant documents through spreading activation.

[1]  Dirk Kenis,et al.  MacPolicy a group decision support system , 1992 .

[2]  Henry G. Small,et al.  Co-citation in the scientific literature: A new measure of the relationship between two documents , 1973, J. Am. Soc. Inf. Sci..

[3]  N. L. Johnson,et al.  Collective Problem Solving: Functionality beyond the Individual , 1998 .

[4]  Ramana Rao,et al.  Silk from a sow's ear: extracting usable structures from the Web , 1996, CHI.

[5]  D. Campbell,et al.  Selection of organization at the social level: Obstacles and facilitators of metasystem transitions , 1995 .

[6]  E. Bonabeau,et al.  Self-organization in social insects. , 1997, Trends in ecology & evolution.

[7]  Luis Mateus Rocha,et al.  Symbiotic intelligence: Self-organizing knowledge on distributed networks, driven by human interaction , 1998 .

[8]  John B. Smith,et al.  Collective Intelligence in Computer-Based Collaboration , 1994 .

[9]  E. Bonabeau,et al.  L'intelligence collective , 1994 .

[10]  I. H. Öğüş,et al.  NATO ASI Series , 1997 .

[11]  Pattie Maes,et al.  Social information filtering: algorithms for automating “word of mouth” , 1995, CHI '95.

[12]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[13]  H. A. Lingstone,et al.  The Delphi Method: Techniques and Applications , 1976 .

[14]  Johan Bollen,et al.  Finding words through spreading activation , 1996 .

[15]  Johan Bollen,et al.  Algorithms for the self-organisation of distributed, multi-user networks. Possible application to the future World Wide Web , 1996 .

[16]  David M. Nichols,et al.  Implicit Rating and Filtering , 1998 .

[17]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[18]  Sergey Brin,et al.  The Anatomy of a Large-Scale Hypertextual Web Search Engine , 1998, Comput. Networks.

[19]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[20]  Richard A. Harshman,et al.  Indexing by Latent Semantic Analysis , 1990, J. Am. Soc. Inf. Sci..

[21]  James Rucker,et al.  Siteseer: personalized navigation for the Web , 1997, CACM.

[22]  Francis Heylighen,et al.  FORMULATING THE PROBLEM OF PROBLEM-FORMULATION , 1988 .

[23]  Brian R. Gaines,et al.  The collective stance in modeling expertise in individuals and organizations , 1994 .

[24]  Léon J. M. Rothkrantz,et al.  Ant-Based Load Balancing in Telecommunications Networks , 1996, Adapt. Behav..

[25]  David Heckerman,et al.  Empirical Analysis of Predictive Algorithms for Collaborative Filtering , 1998, UAI.

[26]  Francis Heylighen,et al.  from entailment meshes via semantic nets to learning webs , 2001 .

[27]  Gerard Salton,et al.  On the use of spreading activation methods in automatic information , 1988, SIGIR '88.

[28]  Y. I. Kim.  [General systems theory]. , 1989, Taehan kanho. The Korean nurse.

[29]  Luis Mateus Rocha,et al.  Symbiotic intelligence (poster): self-organizing knowledge on distributed networks driven by human interaction , 1998 .

[30]  Johan Bollen,et al.  A system to restructure hypertext networks into valid user models , 1998, New Rev. Hypermedia Multim..

[31]  Johan Bollen,et al.  Algorithms for the self-organization of distributed, multi-user networks , 1996 .

[32]  K. Boulding.  General Systems Theory---The Skeleton of Science , 1956 .

[33]  Dhananjay K. Gode,et al.  Allocative Efficiency of Markets with Zero-Intelligence Traders: Market as a Partial Substitute for Individual Rationality , 1993, Journal of Political Economy.

[34]  Luc Steels.  The biology and technology of intelligent autonomous agents , 1995, Robotics Auton. Syst..

[35]  D. Chialvo,et al.  How Swarms Build Cognitive Maps , 1995 .

[36]  L. Steels.  The Biology and Technology of Intelligent Autonomous Agents , 1995, NATO ASI Series.

[37]  Johan Bollen,et al.  The World-Wide Web as a Super-Brain: from metaphor to model , 1996 .

[38]  Pierre Lévy,et al.  Collective Intelligence: Mankind's Emerging World in Cyberspace , 1997 .

[39]  Peter Pirolli,et al.  Life, death, and lawfulness on the electronic frontier , 1997, CHI.

[40]  Francis Heylighen,et al.  The Economy as a Distributed, Learning Control System , 1997 .