Collaboration Analysis Using Deep Learning

The analysis of the collaborative learning process is one of the growing fields of education research, which has many different analytic solutions. In this paper, we provided a new solution to improve automated collaborative learning analyses using deep neural networks. Instead of using self-reported questionnaires, which are subject to bias and noise, we automatically extract group-working information by object recognition results using Mask R-CNN method. This process is based on detecting the people and other objects from pictures and video clips of the collaborative learning process, then evaluate the mobile learning performance using the collaborative indicators. We tested our approach to automatically evaluate the group-work collaboration in a controlled study of thirty-three dyads while performing an anatomy body painting intervention. The results indicate that our approach recognizes the differences of collaborations among teams of treatment and control groups in the case study. This work introduces new methods for automated quality prediction of collaborations among human-human interactions using computer vision techniques.

[1]  P. Dillenbourg What do you mean by collaborative learning , 1999 .

[2]  Alan M. Lesgold,et al.  Modeling the process of collaborative learning , 2007 .

[3]  Reteeba Algoufi Using Tablet on Education , 2016 .

[4]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[5]  Saurabh Pal,et al.  Mining Educational Data to Analyze Students' Performance , 2012, ArXiv.

[6]  César A. Collazos,et al.  Evaluating Collaborative Learning Processes using System-based Measurement , 2007, J. Educ. Technol. Soc..

[7]  Tomaso Poggio,et al.  Models of object recognition , 2000, Nature Neuroscience.

[8]  Alan Liu,et al.  A Survey of Surgical Simulation: Applications, Technology, and Education , 2003, Presence: Teleoperators & Virtual Environments.

[9]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[10]  Milan Sonka,et al.  Image pre-processing , 1993 .

[11]  Farshid Marbouti,et al.  Models for early prediction of at-risk students in a course using standards-based grading , 2016, Comput. Educ..

[12]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  John Dewey,et al.  Democracy in Education , 1903, The Elementary School Teacher.

[14]  César A. Collazos,et al.  Evaluating Collaborative Learning Processes , 2002, CRIWG.

[15]  Christian Dalsgaard,et al.  Social software: E-learning beyond learning management systems , 2006 .

[16]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[17]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[18]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[19]  Sandeep Kumar,et al.  Object Detection and Recognition in Images , 2004 .

[20]  P. McMenamin Body painting as a tool in clinical anatomy teaching , 2008, Anatomical sciences education.

[21]  Alan M. Lesgold,et al.  What Makes Peer Interaction Effective? Modeling Effective Communication in an Intelligent CSCL , 1999 .

[22]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[24]  Marwan F Abu-Hijleh,et al.  The place of anatomy in medical education: Guide Supplement 41.1 – Viewpoint , 2010, Medical teacher.

[25]  Thomas S. Huang,et al.  Image processing , 1971 .

[26]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[27]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[28]  Khe Foon Hew,et al.  A Review of Research Methodologies Used in Studies on Mobile Handheld Devices in K-12 and Higher Education Settings. , 2009 .

[29]  Elaine Nicpon Marieb,et al.  Essentials of human anatomy & physiology laboratory manual , 2011 .

[30]  David S. Doermann,et al.  Text Detection and Recognition in Imagery: A Survey , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Gavin McArdle,et al.  Virtual reality for collaborative e-learning , 2008, Comput. Educ..