Using Learning Analytics to Visualise Computer Science Teamwork

Industry has called upon academia to better prepare Computer Science graduates for teamwork, especially in developing the soft skills necessary for collaborative work. However, the teaching and assessment of teamwork is not easy, with instructors being pressed for time and a lack of tools available to efficiently analyse student teamwork, where large cohorts are involved. We have developed a teamwork dashboard, founded on learning analytics, learning theory and teamwork models that analyses students' online teamwork discussion data and visualises the team mood, role distribution and emotional climate. This tool allows educators to easily monitor teams in real-time. Educators may use the tool to provide students with feedback about team interactions as well as to identify problematic teams. We present a case study, trialing the dashboard on one university Computer Science course and include reflections from the course lecturer to determine its utility in monitoring online student teamwork.

[1]  Maren Scheffel,et al.  CAMera for PLE , 2009, EC-TEL.

[2]  Shane Dawson,et al.  SNAPP: a bird's-eye view of temporal participant interaction , 2011, LAK.

[3]  Yorick Wilks,et al.  The grammar of sense: Using part-of-speech tags as a first step in semantic disambiguation , 1998, Natural Language Engineering.

[4]  Nickolas J. G. Falkner,et al.  Analysing computer science students' teamwork role adoption in an online self-organised teamwork activity , 2013, Koli Calling '13.

[5]  Rebecca Ferguson,et al.  Social Learning Analytics , 2012, J. Educ. Technol. Soc..

[6]  Erik Duval,et al.  Visualizing Activities for Self-reflection and Awareness , 2010, ICWL.

[7]  Erkki Sutinen,et al.  Exploiting sentiment analysis to track emotions in students' learning diaries , 2013, Koli Calling '13.

[8]  R. Mcintyre,et al.  A Conceptual Framework for Teamwork Measurement , 1997 .

[9]  Lei Zhang,et al.  Sentiment Analysis and Opinion Mining , 2017, Encyclopedia of Machine Learning and Data Mining.

[10]  M. Robles.  Executive Perceptions of the Top 10 Soft Skills Needed in Today’s Workplace , 2012 .

[11]  Aziz Sheikh,et al.  The case study approach , 2011, BMC medical research methodology.

[12]  L. Willcoxson.  “It’s not Fair!”: Assessing the Dynamics and Resourcing of Teamwork , 2006 .

[13]  Steven K. Jones,et al.  Developing and assessing college student teamwork skills , 2011 .

[14]  Nmc Horizon.  NMC Horizon Report: 2013 Higher Education Edition (I) , 2013 .

[15]  Michael Carter,et al.  Communication learning outcomes from software engineering professionals: A basis for teaching communication in the engineering curriculum , 2009, 2009 39th IEEE Frontiers in Education Conference.

[16]  Joonhwan Lee,et al.  A Framework for Assessment of Student Project Groups On-Line and Off-Line , 2011 .

[17]  Nickolas J. G. Falkner,et al.  Visualisation of learning management system usage for detecting student behaviour patterns , 2013, ACE '13.

[18]  Simon Buckingham Shum,et al.  Discourse-centric learning analytics , 2011, LAK.

[19]  Mattias Wiggberg.  Computer Science Project Courses : Contrasting Students’ Experiences with Teachers’ Expectations , 2010 .

[20]  Philipp Koehn,et al.  Synthesis Lectures on Human Language Technologies , 2016 .

[21]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[22]  Nobuko Fujita,et al.  Scholarship at UWindsor Scholarship at UWindsor Towards Visual Analytics for Teachers’ Dynamic Diagnostic Towards Visual Analytics for Teachers’ Dynamic Diagnostic Pedagogical Decision-Making Pedagogical Decision-Making , 2011 .

[23]  Nickolas J. G. Falkner,et al.  Collaborative learning and anxiety: a phenomenographic study of collaborative learning activities , 2013, SIGCSE '13.

[24]  Erik Duval,et al.  Visualizing PLE usage , 2011 .

[25]  Cindy E. Hmelo-Silver,et al.  Analyzing collaborative knowledge construction: multiple methods for integrated understanding , 2003, Comput. Educ..