Using big data techniques for measuring productive friction in mass collaboration online environments

The advent of the social web brought with it challenges and opportunities for research on learning and knowledge construction. Using the online-encyclopedia Wikipedia as an example, we discuss several methods that can be applied to analyze the dynamic nature of knowledge-related processes in mass collaboration environments. These methods can help in the analysis of the interactions between the two levels that are relevant in computer-supported collaborative learning (CSCL) research: The individual level of learners and the collective level of the group or community. In line with constructivist theories of learning, we argue that the development of knowledge on both levels is triggered by productive friction, that is, the prolific resolution of socio-cognitive conflicts. By describing three prototypical methods that have been used in previous Wikipedia research, we review how these techniques can be used to examine the dynamics on both levels and analyze how these dynamics can be predicted by the amount of productive friction. We illustrate how these studies make use of text classifiers, social network analysis, and cluster analysis in order to operationalize the theoretical concepts. We conclude by discussing implications for the analysis of dynamic knowledge processes from a learning sciences perspective.

[1]  U. Cress,et al.  How Structure Shapes Dynamics: Knowledge Development in Wikipedia - A Network Multilevel Modeling Approach , 2014, PloS one.

[2]  Ameet Talwalkar,et al.  Foundations of Machine Learning , 2012, Adaptive computation and machine learning.

[3]  G. Caldarelli,et al.  The spreading of misinformation online , 2016, Proceedings of the National Academy of Sciences.

[4]  M. Castells.  End of Millennium: The Information Age: Economy, Society and Culture , 1997 .

[5]  Marlene Scardamalia,et al.  Computer Support for Knowledge-Building Communities , 1994 .

[6]  Ulrike Cress,et al.  Explaining authors’ contribution to pivotal artifacts during mass collaboration in the Wikipedia’s knowledge base , 2013, International Journal of Computer-Supported Collaborative Learning.

[7]  Grace Gu,et al.  Ideological Segregation Among Online Collaborators: Evidence from Wikipedians , 2016 .

[8]  Ulrike Cress,et al.  Mass Collaboration as Coevolution of Cognitive and Social Systems , 2016 .

[9]  K. Hakkarainen,et al.  Toward a trialogical approach to learning , 2009 .

[10]  B. Wellman.  Physical Place and Cyberplace: The Rise of Personalized Networking , 2001 .

[11]  M. De Paola,et al.  Peer Effects in Higher Education: Does the Field of Study Matter? , 2010 .

[12]  I. Nonaka,et al.  The Knowledge Creating Company , 2008 .

[13]  M. Tushman,et al.  Boundary Spanning Individuals: Their Role in Information Transfer and Their Antecedents , 1981 .

[14]  Eric Brewe,et al.  Talking and Learning Physics: Predicting Future Grades from Network Measures and Force Concept Inventory Pretest Scores. , 2013 .

[15]  Judith Kleine Staarman,et al.  Wiki-supported collaborative learning in primary education: How a dialogic space is created for thinking together , 2011, Int. J. Comput. Support. Collab. Learn..

[16]  Dominik Kowald,et al.  AFEL: Towards Measuring Online Activities Contributions to Self-directed Learning , 2017, ARTEL@EC-TEL.

[17]  Ulrike Cress,et al.  The Interrelations of Individual Learning and Collective Knowledge Construction: A Cognitive-Systemic Framework , 2017 .

[18]  Ulrike Cress,et al.  Wiki-supported learning and knowledge building: effects of incongruity between knowledge and information , 2009, J. Comput. Assist. Learn..

[19]  Ulrike Cress,et al.  Preference-inconsistent recommendations: An effective approach for reducing confirmation bias and stimulating divergent thinking? , 2012, Comput. Educ..

[20]  S. Engel.  Thought and Language , 1964 .

[21]  Productive Friction: How Conflict in Student Teaching Creates Opportunities for Learning at the Boundary. , 2011 .

[22]  Janet E. Hurn,et al.  Using learning analytics to predict (and improve) student success: a faculty perspective , 2013 .

[23]  Ulrike Cress,et al.  What Is Knowledge? Who Creates It? Who Possesses It? The Need for Novel Answers to Old Questions , 2016 .

[24]  Humberto R. Maturana,et al.  The organization of the living: A theory of the living organization , 1975 .

[25]  Rebecca Ferguson,et al.  Learning analytics: drivers, developments and challenges , 2012 .

[26]  Wilhelmiina Hämäläinen,et al.  Classifiers for educational data mining , 2010 .

[27]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[28]  Daniel J. Brass,et al.  Network Analysis in the Social Sciences , 2009, Science.

[29]  A. Collins,et al.  Situated Cognition and the Culture of Learning , 1989 .

[30]  Ulrike Cress,et al.  A systemic and cognitive view on collaborative knowledge building with wikis , 2008, Int. J. Comput. Support. Collab. Learn..

[31]  Yrjö Engeström,et al.  Expansive Visibilization of Work: An Activity-Theoretical Perspective , 1999, Computer Supported Cooperative Work (CSCW).

[32]  W. Doise,et al.  Social interaction and the development of cognitive operations , 1975 .

[33]  L. Freeman.  Centrality in social networks conceptual clarification , 1978 .

[34]  Faisal Kalota.  Applications of Big Data in Education , 2015 .

[35]  Lauren B. Resnick,et al.  Shared cognition: Thinking as social practice , 1991, Perspectives on socially shared cognition.

[36]  J. Rysiewicz.  Cognitive Profiles of (Un)successful FL Learners: A Cluster Analytical Study , 2008 .

[37]  U. Cress,et al.  How students deal with inconsistencies in health knowledge , 2013, Medical education.

[38]  Ulrike Cress,et al.  All in good time: knowledge introduction, restructuring, and development of shared opinions as different stages in collaborative writing , 2017, International Journal of Computer-Supported Collaborative Learning.

[39]  J. Greeno.  On Claims That Answer the Wrong Questions , 1997 .

[40]  Carolyn Penstein Rosé,et al.  Learning analytics and machine learning , 2014, LAK.

[41]  Eugene Matusov,et al.  Intersubjectivity as a way of informing teaching design for a community of learners classroom , 2001 .

[42]  Ulrike Cress,et al.  "Scientific evidence is very important for me": The impact of behavioral intention and the wording of user inquiries on replies and recommendations in a health-related online forum , 2017, Comput. Hum. Behav..

[43]  Céline Darnon,et al.  Dealing with a disagreeing partner: Relational and epistemic conflict elaboration , 2007 .

[44]  Timo Honkela,et al.  Knowledge Practices, Epistemic Technologies, and Pragmatic Web , 2009, I-SEMANTICS.

[45]  Katrien Verbert,et al.  Panorama of Recommender Systems to Support Learning , 2015, Recommender Systems Handbook.

[46]  Xin Chen,et al.  Mining Social Media Data for Understanding Students’ Learning Experiences , 2014, IEEE Transactions on Learning Technologies.

[47]  L. Harlow,et al.  Big data in psychology: Introduction to the special issue. , 2016, Psychological methods.

[48]  A. Hermida,et al.  SHARE, LIKE, RECOMMEND , 2012 .

[49]  P. Prinsloo,et al.  Learning Analytics , 2013 .

[50]  Peter Holtz,et al.  Effects of Contributor Experience on the Quality of Health-Related Wikipedia Articles , 2018, Journal of medical Internet research.

[51]  Chris Piech,et al.  Deconstructing disengagement: analyzing learner subpopulations in massive open online courses , 2013, LAK '13.

[52]  A. Nowak,et al.  Big Data In Psychological Research , 2017 .

[53]  J. Piaget,et al.  The Development of Thought: Equilibration of Cognitive Structures , 1977 .

[54]  Vic Lally,et al.  Investigating patterns of interaction in networked learning and computer-supported collaborative learning: A role for Social Network Analysis , 2007, Int. J. Comput. Support. Collab. Learn..

[55]  George Siemens,et al.  Penetrating the fog: analytics in learning and education , 2014 .

[56]  I. Nonaka.  A Dynamic Theory of Organizational Knowledge Creation , 1994 .

[57]  Dragan Gasevic,et al.  Handbook of Learning Analytics , 2017 .

[58]  Manu Kapur.  Productive Failure , 2006, ICLS.

[59]  Ulrike Cress,et al.  Visualizing wiki-supported knowledge building: co-evolution of individual and collective knowledge , 2008, Int. Sym. Wikis.

[60]  Wenhua Wang,et al.  Large Scale of E-learning Resources Clustering with Parallel Affinity Propagation , 2008 .

[61]  S. Schulz-Hardt,et al.  Confirmation bias in sequential information search after preliminary decisions: an expansion of dissonance theoretical research on selective exposure to information. , 2001, Journal of personality and social psychology.

[62]  Xiaojun Wan,et al.  Multi-document summarization using cluster-based link analysis , 2008, SIGIR '08.

[63]  Danielle S. McNamara,et al.  ReaderBench: Automated evaluation of collaboration based on cohesion and dialogism , 2015, International Journal of Computer-Supported Collaborative Learning.

[64]  Walt Detmar Meurers,et al.  A productive clash of perspectives? The interplay between articles’ and authors’ perspectives and their impact on Wikipedia edits in a controversial domain , 2017, PloS one.

[65]  Ulrike Cress,et al.  VISUALIZING CO-EVOLUTION OF INDIVIDUAL AND COLLECTIVE KNOWLEDGE , 2010 .

[66]  Ahmad Taher Azar,et al.  Rough set-based meta-heuristic clustering approach for social e-learning systems , 2015, Int. J. Intell. Eng. Informatics.

[67]  Hagel J rd,et al.  Productive friction: how difficult business partnerships can accelerate innovation. , 2005 .

[68]  Ulrike Cress,et al.  Learning and Collective Knowledge Construction With Social Media: A Process-Oriented Perspective , 2015, Educational psychologist.

[69]  R. Wegerif.  Dialogic Education and Technology , 2007 .

[70]  Brian Everitt,et al.  Cluster analysis , 1974 .

[71]  Lada A. Adamic,et al.  Exposure to ideologically diverse news and opinion on Facebook , 2015, Science.

[72]  Jean Piaget,et al.  Possibility and Necessity , 1987 .

[73]  Andreas S. Rath,et al.  Automatic detection of accommodation steps as an indicator of knowledge maturing , 2011, Interact. Comput..

[74]  A. Wise,et al.  Why Theory Matters More than Ever in the Age of Big Data , 2015, J. Learn. Anal..

[75]  Ulrike Cress,et al.  Knowledge Construction in Wikipedia: A Systemic-Constructivist Analysis , 2014 .

[76]  K. Vohs,et al.  Psychology as the Science of Self-reports and Finger Movements Whatever Happened to Actual Behavior? , 2022 .

[77]  Ulrike Cress,et al.  Emotional Content in Wikipedia Articles on Negative Man-Made and Nature-Made Events , 2017 .

[78]  Traian Rebedea,et al.  A Deep Insight in Chat Analysis: Collaboration, Evolution and Evaluation, Summarization and Search , 2010, AIMSA.

[79]  Anthony G. Picciano.  The Evolution of Big Data and Learning Analytics in American Higher Education , 2012 .

[80]  Rheta Devries.  Piaget's Social Theory , 1997 .

[81]  J. Bruner.  The Culture of Education , 1996 .

[82]  Catherine Happer,et al.  The Role of the Media in the Construction of Public Belief and Social Change , 2013 .

[83]  Ulrike Cress,et al.  Collaborative knowledge building with wikis: The impact of redundancy and polarity , 2012, Comput. Educ..

[84]  L. Lipponen,et al.  Models of Innovative Knowledge Communities and Three Metaphors of Learning , 2004 .

[85]  Ulrike Cress,et al.  Joint interactions in large online knowledge communities: The A3C framework , 2017, International Journal of Computer-Supported Collaborative Learning.

[86]  Steven M. Goodreau,et al.  Understanding Classrooms through Social Network Analysis: A Primer for Social Network Analysis in Education Research , 2014, CBE life sciences education.

[87]  Pavlo D. Antonenko,et al.  Using cluster analysis for data mining in educational technology research , 2012, Educational Technology Research and Development.

[88]  D. Diforio,et al.  Schizophrenia: a neural diathesis-stress model. , 1997, Psychological review.

[89]  Dominik Kowald,et al.  Which Algorithms Suit Which Learning Environments? A Comparative Study of Recommender Systems in TEL , 2016, EC-TEL.

[90]  W. Doise,et al.  Socio-cognitive conflict and structure of individual and collective performances , 1978 .