Analyzing the flow of knowledge in computer mediated teams

In this article, we present an analysis of communication transcripts from computer-mediated teams that illustrates how different kinds of decision support impact collaborative knowledge construction. Our analysis introduces an algorithmic technique called Topic Evolution Analysis (TEvA), which tracks clusters of words in conversation, and illustrates how these clusters change and merge over time. This analysis is combined with measurements of group dynamics to distinguish between teams using different kinds of decision support. Our analysis offers evidence that some kinds of decision support improve the apparent rationality of a team, but at the cost of collaborative knowledge construction. This result is not apparent when simply measuring team decision performance. We use this finding to motivate the utility and importance of the approach when assessing the impact of technology on collaborative knowledge processing.

[1]  D. Meyer,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S6 References Evidence for a Collective Intelligence Factor in the Performance of Human Groups , 2022 .

[2]  Jacob Ratkiewicz,et al.  Truthy: mapping the spread of astroturf in microblog streams , 2010, WWW.

[3]  Alyssa Friend Wise,et al.  Analyzing temporal patterns of knowledge construction in a role-based online discussion , 2011, Int. J. Comput. Support. Collab. Learn..

[4]  Nancy Pennington,et al.  Explanation-based decision making. , 2000 .

[5]  Detlef Schoder,et al.  Web Science 2.0: Identifying Trends through Semantic Social Network Analysis , 2008, 2009 International Conference on Computational Science and Engineering.

[6]  Lada A. Adamic,et al.  Memes Online: Extracted, Subtracted, Injected, and Recollected , 2011, ICWSM.

[7]  D. Kuhn.  THE SKILLS OF ARGUMENT , 2008, Education for Thinking.

[8]  Candace L. Sidner,et al.  Attention, Intentions, and the Structure of Discourse , 1986, CL.

[9]  Susan T. Dumais,et al.  Characterizing Microblogs with Topic Models , 2010, ICWSM.

[10]  Maliha S. Nash,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 2001, Technometrics.

[11]  John D. Lafferty,et al.  Dynamic topic models , 2006, ICML.

[12]  James A. Danowski.  WORDIJ: A Word Pair Approach to Information Retrieval , 1992, TREC.

[13]  M. S. Poole.  Decision development in small groups: III. A multiple sequence model of group decision development. , 1983 .

[14]  Jure Leskovec,et al.  Meme-tracking and the dynamics of the news cycle , 2009, KDD.

[15]  C. Sunstein.  Infotopia: How Many Minds Produce Knowledge , 2006 .

[16]  Stephanie D. Teasley,et al.  Proceedings of the ACM 2009 international conference on Supporting group work , 2009, GROUP 2009.

[17]  Jacob Ratkiewicz,et al.  Political Polarization on Twitter , 2011, ICWSM.

[18]  Matthijs J. Warrens,et al.  On the Equivalence of Cohen’s Kappa and the Hubert-Arabie Adjusted Rand Index , 2008, J. Classif..

[19]  N. Pennington,et al.  Reasoning in explanation-based decision making , 1993, Cognition.

[20]  A. Barabasi,et al.  Quantifying social group evolution , 2007, Nature.

[21]  Kurt Hornik,et al.  topicmodels : An R Package for Fitting Topic Models , 2016 .

[22]  Jacob Ratkiewicz,et al.  Detecting and Tracking the Spread of Astroturf Memes in Microblog Streams , 2010, ArXiv.

[23]  Chong Wang,et al.  Reading Tea Leaves: How Humans Interpret Topic Models , 2009, NIPS.

[24]  John H. Kagel,et al.  Information Exchange in Group Decision Making: The Hidden Profile Problem Reconsidered , 2009, Manag. Sci..

[25]  G. Stasser,et al.  Pooling of Unshared Information in Group Decision Making: Biased Information Sampling During Discussion , 1985 .

[26]  T. Vicsek,et al.  Uncovering the overlapping community structure of complex networks in nature and society , 2005, Nature.

[27]  M. Meilă.  Comparing clusterings---an information based distance , 2007 .

[28]  Charlotte N. Gunawardena,et al.  Analysis of a Global Online Debate and the Development of an Interaction Analysis Model for Examining Social Construction of Knowledge in Computer Conferencing , 1997 .

[29]  John D. Lafferty,et al.  A correlated topic model of Science , 2007, 0708.3601.

[30]  Joshua Introne.  Supporting group decisions by mediating deliberation to improve information pooling , 2009, GROUP '09.

[31]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[32]  Erik Brynjolfsson,et al.  Global Village or Cyberbalkans: Modeling and Measuring the Integration of Electronic Communities , 2005, Manag. Sci..

[33]  Xin Tong,et al.  TextFlow: Towards Better Understanding of Evolving Topics in Text , 2011, IEEE Transactions on Visualization and Computer Graphics.

[34]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[35]  Ruslan Salakhutdinov,et al.  Evaluation methods for topic models , 2009, ICML '09.

[36]  Alan R. Dennis,et al.  Information Exchange and Use in Group Decision Making: You Can Lead a Group to Information, but You Can't Make It Think , 1996, MIS Q..

[37]  Jianwen Zhang,et al.  Evolutionary hierarchical dirichlet processes for multiple correlated time-varying corpora , 2010, KDD.

[38]  M. Cugmas,et al.  On comparing partitions , 2015 .