Toward collaboration sensing

We describe preliminary applications of network analysis techniques to eye-tracking data collected during a collaborative learning activity. This paper makes three contributions: first, we visualize collaborative eye-tracking data as networks, where the nodes of the graph represent fixations and edges represent saccades. We found that those representations can serve as starting points for formulating research questions and hypotheses about collaborative processes. Second, network metrics can be computed to interpret the properties of the graph and find proxies for the quality of students’ collaboration. We found that different characteristics of our graphs correlated with different aspects of students’ collaboration (for instance, the extent to which students reached consensus was associated with the average size of the strongly connected components of the graphs). Third, we used those characteristics to predict the quality of students’ collaboration by feeding those features into a machine-learning algorithm. We found that among the eight dimensions of collaboration that we considered, we were able to roughly predict (using a median-split) students’ quality of collaboration with an accuracy between ~85 and 100 %. We conclude by discussing implications for developing “collaboration-sensing” tools, and comment on implementing this approach for formal learning environments.

[1]  Daniel C. Richardson,et al.  Looking To Understand: The Coupling Between Speakers' and Listeners' Eye Movements and Its Relationship to Discourse Comprehension , 2005, Cogn. Sci..

[2]  Liza Catán,et al.  The Dynamic Display of Process: Historical Development and Contemporary Uses of the Microgenetic Method , 1986 .

[3]  Wolff‐Michael Roth Gestures: Their Role in Teaching and Learning , 2001 .

[4]  Odhiambo Anacleti,et al.  Who is the expert , 1995 .

[5]  John R. Anderson Cognitive Psychology and Its Implications , 1980 .

[6]  P. Erdos,et al.  On the evolution of random graphs , 1984 .

[7]  Jeffrey Heer,et al.  Divided Edge Bundling for Directional Network Data , 2011, IEEE Transactions on Visualization and Computer Graphics.

[8]  A. Luria,et al.  The Development of Writing in the Child , 1977 .

[9]  Klaus Krippendorff,et al.  Answering the Call for a Standard Reliability Measure for Coding Data , 2007 .

[10]  Elizabeth Bates,et al.  Integrating Language and Gesture in Infancy. , 1989 .

[11]  Brigid Barron When Smart Groups Fail , 2003 .

[12]  J. Flavell,et al.  A microgenetic approach to perception and thought. , 1957, Psychological bulletin.

[13]  Bertrand Schneider,et al.  Real-time mutual gaze perception enhances collaborative learning and collaboration quality , 2013, International Journal of Computer-Supported Collaborative Learning.

[14]  Leonard M. Freeman,et al.  A set of measures of centrality based upon betweenness , 1977 .

[15]  Charles Goodwin,et al.  Embodied Interaction: Language And Body In The Material World , 2014 .

[16]  Andrew N Meltzoff,et al.  Infant gaze following and pointing predict accelerated vocabulary growth through two years of age: a longitudinal, growth curve modeling study* , 2008, Journal of Child Language.

[17]  Roy,et al.  The Social and Technological Dimensions of Scaffolding and Related Theoretical Concepts for Learning , Education , and Human Activity , 2004 .

[18]  Daniel L. Schwartz,et al.  Inventing to Prepare for Future Learning: The Hidden Efficiency of Encouraging Original Student Production in Statistics Instruction , 2004 .

[19]  M. Tomasello Joint attention as social cognition. , 1995 .

[20]  Patrick Jermann,et al.  Collaborative Gaze Footprints: Correlates of Interaction Quality , 2011, CSCL.

[21]  L. Hearnshaw,et al.  The comparative psychology of mental development , 1966 .

[22]  Douglas C. Engelbart,et al.  A conceptual framework for the augmentation of man's intellect , 1988 .

[23]  V. Rosenthal,et al.  Microgenesis, immediate experience and visual processes in reading. , 2004 .

[24]  K J Rothman,et al.  No Adjustments Are Needed for Multiple Comparisons , 1990, Epidemiology.

[25]  B. Weinstein What is an expert? , 1993, Theoretical medicine.

[26]  J. C. R. Licklider,et al.  Man-Computer Symbiosis , 1960 .

[27]  Nikol Rummel,et al.  A rating scheme for assessing the quality of computer-supported collaboration processes , 2007, Int. J. Comput. Support. Collab. Learn..

[28]  Pierre Dillenbourg,et al.  Deixis and gaze in collaborative work at a distance (over a shared map): a computational model to detect misunderstandings , 2008, ETRA.

[29]  Edward M. Reingold,et al.  Graph drawing by force‐directed placement , 1991, Softw. Pract. Exp..

[30]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[31]  Daniel L. Schwartz,et al.  The Emergence of Abstract Representations in Dyad Problem Solving , 1995 .

[32]  Pierre Dillenbourg,et al.  Who is the expert? Analyzing gaze data to predict expertise level in collaborative applications , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[33]  Daniel N. Stern,et al.  The First Relationship: Infant and Mother , 1977 .

[34]  C. Moore,et al.  Joint attention : its origins and role in development , 1995 .

[35]  James V. Wertsch,et al.  Culture, communication, and cognition : Vygotskian perspectives , 1987 .

[36]  B. Bollobás The evolution of random graphs , 1984 .

[37]  Heinz Werner,et al.  Comparative Psychology of Mental Development , 1942 .

[38]  H. Werner,et al.  Microgenesis and aphasia. , 1956, Journal of abnormal psychology.

[39]  J. Pellegrino,et al.  Education for Life and Work: Developing Transferable Knowledge and Skills in the 21st Century , 2013 .