An artificial intelligence tool for heterogeneous team formation in the classroom

Abstract Nowadays, there is increasing interest in the development of teamwork skills in the educational context. This growing interest is motivated by its pedagogical effectiveness and the fact that, in labour contexts, enterprises organise their employees in teams to carry out complex projects. Despite its crucial importance in the classroom and industry, there is a lack of support for the team formation process. Not only do many factors influence team performance, but the problem becomes exponentially costly if teams are to be optimised. In this article, we propose a tool whose aim it is to cover such a gap. It combines artificial intelligence techniques such as coalition structure generation, Bayesian learning, and Belbin’s role theory to facilitate the generation of working groups in an educational context. This tool improves current state of the art proposals in three ways: i) it takes into account the feedback of other teammates in order to establish the most predominant role of a student instead of self-perception questionnaires; ii) it handles uncertainty with regard to each student’s predominant team role; iii) it is iterative since it considers information from several interactions in order to improve the estimation of role assignments. We tested the performance of the proposed tool in an experiment involving students that took part in three different team activities. The experiments suggest that the proposed tool is able to improve different teamwork aspects such as team dynamics and student satisfaction.

[1]  Saskia Brand-Gruwel,et al.  Students' experiences with collaborative learning in asynchronous Computer-Supported Collaborative Learning environments , 2004, Comput. Hum. Behav..

[2]  Alan Agresti,et al.  Categorical Data Analysis , 2003 .

[3]  Elena del Val Noguera,et al.  A Team Formation Tool for Educational Environments , 2014, PAAMS.

[4]  Terri Fredrick Facilitating Better Teamwork: Analyzing the Challenges and Strategies of Classroom-Based Collaboration , 2008 .

[5]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[6]  Jorge Andrés Díaz Pace,et al.  Using constraint satisfaction to aid group formation in CSCL , 2014, Inteligencia Artif..

[7]  Yen-Ting Lin,et al.  An automatic group composition system for composing collaborative learning groups using enhanced particle swarm optimization , 2010, Comput. Educ..

[8]  Minou Ella Mebane,et al.  Developing professional skills and social capital through computer supported collaborative learning in university contexts , 2007, Int. J. Hum. Comput. Stud..

[9]  Demetrio Arturo Ovalle Carranza,et al.  A genetic algorithm approach for group formation in collaborative learning considering multiple student characteristics , 2012, Comput. Educ..

[10]  R. Sternberg,et al.  Styles of Thinking, Abilities, and Academic Performance , 1997 .

[11]  Vincent Conitzer,et al.  Coalition Structure Generation Utilizing Compact Characteristic Function Representations , 2009, CP.

[12]  Barbara Senior,et al.  *Belbin's Team Role Model: Development, Validity and Applications for Team Building , 2007 .

[13]  E. Sundstrom,et al.  Work teams: Applications and effectiveness. , 1990 .

[14]  Rosanna N. Costaguta,et al.  A Multi-agent Model That Promotes Team-Role Balance in Computer Supported Collaborative Learning , 2011, ADNTIIC.

[15]  Vicente Julián,et al.  Simulating a Collective Intelligence Approach to Student Team Formation , 2013, HAIS.

[16]  C. Howe,et al.  Social effects of collaborative learning in primary schools , 2010 .

[17]  Belén Melián-Batista,et al.  A Study of Rescheduling Strategies for the Quay Crane Scheduling Problem under Random Disruptions , 2014, Inteligencia Artif..

[18]  Asma Ounnas,et al.  A Framework for Semantic Group Formation in Education , 2009, J. Educ. Technol. Soc..

[19]  Chuen-Tsai Sun,et al.  DIANA: A computer-supported heterogeneous grouping system for teachers to conduct successful small learning groups , 2007, Comput. Hum. Behav..

[20]  Ming-Chung Yang,et al.  AN OPTIMALITY THEORY FOR MID p-VALUES IN 2 × 2 CONTINGENCY TABLES , 2001 .

[21]  Greg L. Stewart,et al.  AN EXPLORATION OF MEMBER ROLES AS A MULTILEVEL LINKING MECHANISM FOR INDIVIDUAL TRAITS AND TEAM OUTCOMES , 2005 .

[22]  A. Agresti,et al.  Approximate is Better than “Exact” for Interval Estimation of Binomial Proportions , 1998 .

[23]  J. Kidd Management Teams: Why They Succeed or Fail , 1982 .

[24]  Peter van Rosmalen,et al.  Team formation instruments to enhance learner interactions in open learning environments , 2015, Comput. Hum. Behav..

[25]  Sallie M. Henry,et al.  Using Belbin's leadership role to improve team effectiveness: An empirical investigation , 1999, J. Syst. Softw..

[26]  I. B. Myers Manual: A Guide to the Development and Use of the Myers-Briggs Type Indicator , 1985 .

[27]  D. van Dierendonck,et al.  Belbin revisited: A multitrait–multimethod investigation of a team role instrument , 2011 .

[28]  Willard G. Broucek,et al.  An assessment of the construct validity of the Belbin Self‐Perception Inventory and Observer's Assessment from the perspective of the five‐factor model , 1996 .

[29]  D. Fay,et al.  Getting the most out of multidisciplinary teams: A multi-sample study of team innovation in health care , 2006 .

[30]  Glenn M. Parker,et al.  Team players and team work : new strategies for developing successful collaboration , 2008 .

[31]  R. Meredith Belbin,et al.  Team Roles at Work , 2022 .

[32]  M. Higgs,et al.  Influence of team composition and task complexity on team performance , 2005 .

[33]  Gareth R. Jones,et al.  The experience and evolution of trust: Implications for cooperation and teamwork , 1998 .

[34]  Patricia Huddleston,et al.  Does It Matter if I Hate Teamwork? What Impacts Student Attitudes toward Teamwork , 2003 .

[35]  Tammy L. Rapp,et al.  Team Effectiveness 1997-2007: A Review of Recent Advancements and a Glimpse Into the Future , 2008 .

[36]  Pina Tarricone,et al.  Employees, teamwork and social interdependence – a formula for successful business? , 2002 .

[37]  James Sommerville,et al.  Project teambuilding—the applicability of Belbin's team-role self-perception inventory , 1998 .

[38]  Baltasar Fernández-Manjón,et al.  Learning teamwork skills in university programming courses , 2009, Comput. Educ..

[39]  L. Ross,et al.  Objectivity in the eye of the beholder: divergent perceptions of bias in self versus others. , 2004, Psychological review.

[40]  A. Tsukamoto Styles of Thinking , 1996 .

[41]  Jeanne M. Brett,et al.  The Team Negotiation Challenge: Defining and Managing the Internal Challenges of Negotiating Teams , 2008 .

[42]  R. Meredith Belbin,et al.  Management Teams: Why They Succeed or Fail (3rd ed.) , 2011 .

[43]  John E. Mathieu,et al.  Team Role Experience and Orientation , 2015 .

[44]  John A. Ross The Reliability, Validity, and Utility of Self-Assessment , 2006 .

[45]  Silvia Teresita Acuña,et al.  Formal model for assigning human resources to teams in software projects , 2011, Inf. Softw. Technol..

[46]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[47]  Adrian Furnham,et al.  A psychometric assessment of the Belbin Team‐Role Self‐Perception Inventory , 1993 .

[48]  J. Mathieu,et al.  The influence of shared mental models on team process and performance. , 2000, The Journal of applied psychology.

[49]  Mark King,et al.  Team Machine: A Decision Support System for Team Formation , 2014 .

[50]  Sabine Graf,et al.  Forming Heterogeneous Groups for Intelligent Collaborative Learning Systems with Ant Colony Optimization , 2006, Intelligent Tutoring Systems.

[51]  Barbara Senior Team roles and team performance: Is there ‘really’ a link? , 1997 .

[52]  Paraje Arroyo Seco,et al.  An assistant for group formation in CSCL based on constraint satisfaction , 2013 .

[53]  Elisabeth Dunne,et al.  Bridging the Gap Between Industry and Higher Education: Training Academics to Promote Student Teamwork , 2000 .

[54]  Stephen E. Humphrey,et al.  Developing a theory of the strategic core of teams: a role composition model of team performance. , 2009, The Journal of applied psychology.

[55]  Kyparisia A. Papanikolaou,et al.  A Group Formation Tool in an E-Learning Context , 2007, 19th IEEE International Conference on Tools with Artificial Intelligence(ICTAI 2007).

[56]  Susan E. Jackson,et al.  Team composition in organizational settings: Issues in managing an increasingly diverse work force. , 1991 .

[57]  J. Prichard,et al.  Testing Belbin's Team Role Theory of Effective Groups. , 1999 .

[58]  R. Bales Interaction process analysis; a method for the study of small groups. , 2013 .

[59]  Elaine King,et al.  The roles of student musicians in quartet rehearsals , 2006 .

[60]  Stephanie G. Adams,et al.  Building Successful Student Teams in the Engineering Classroom , 2004 .

[61]  Z. Anusz [Statistics in epidemiology]. , 1974, Pielegniarka i polozna.

[62]  N. Kerr,et al.  Group performance and decision making. , 2004, Annual review of psychology.

[63]  Glenn M. Parker Cross Functional Teams: Working with Allies, Enemies, and Other Strangers , 1994 .

[64]  Heng-Yu Ku,et al.  Collaboration factors, teamwork satisfaction, and student attitudes toward online collaborative learning , 2013, Comput. Hum. Behav..

[65]  O. John,et al.  Accuracy and bias in self-perception: individual differences in self-enhancement and the role of narcissism. , 1994, Journal of personality and social psychology.

[66]  Vincent Conitzer,et al.  Coalition Structure Generation Utilizing Compact Characteristic Function Representations , 2011 .

[67]  Violina Ratcheva,et al.  Integrating diverse knowledge through boundary spanning processes – The case of multidisciplinary project teams , 2009 .

[68]  C. D. De Dreu,et al.  Task versus relationship conflict, team performance, and team member satisfaction: a meta-analysis. , 2003, The Journal of applied psychology.

[69]  Stephen Swailes,et al.  A Comparison of the Belbin Self Perception Inventory and Observer’s Assessment Sheet as Measures of an Individual’s Team Roles , 1998 .

[70]  Analía Amandi,et al.  A Memetic Algorithm for Collaborative Learning Team Formation in the Context of Software Engineering Courses , 2011, ADNTIIC.

[71]  Gerry Stahl,et al.  Group Cognition: Computer Support for Building Collaborative Knowledge (Acting with Technology) , 2006 .

[72]  Mazhil Rajendran,et al.  Analysis of team effectiveness in software development teams working on hardware and software environments using Belbin Self‐perception Inventory , 2005 .

[73]  Deborah G. Ancona,et al.  Beyond Task and Maintenance , 1988 .

[74]  Rénette J. Blignaut,et al.  Teamwork: can it equip university science students with more than rigid subject knowledge? , 1998, Comput. Educ..

[75]  Jan Graffelman,et al.  The mid p-value in exact tests for Hardy-Weinberg equilibrium , 2013, Statistical applications in genetics and molecular biology.

[76]  Richard A. Layton,et al.  Automating The Process Of Assigning Students To Cooperative Learning Teams , 2004 .

[77]  P. M. Alexander,et al.  Virtual teamwork in very large undergraduate classes , 2006, Comput. Educ..

[78]  Bertrand Schneider,et al.  Benefits of a Tangible Interface for Collaborative Learning and Interaction , 2011, IEEE Transactions on Learning Technologies.

[79]  Alfred Kobsa,et al.  Advances in New Technologies, Interactive Interfaces and Communicability , 2011, Lecture Notes in Computer Science.

[80]  Stephen Fisher,et al.  Further evidence concerning the Belbin Team Role Self‐perception Inventory , 1996 .

[81]  Frances S. Grodzinsky,et al.  Building Successful On-line Learning Communities Across International Boundaries: A Case Study , 2004 .

[82]  Denis D. Smith Crisis Management Teams: Issues in the Management of Operational Crises , 2000 .

[83]  Michael D. Ensley,et al.  A comparative study of new venture top management team composition, dynamics and performance between university-based and independent start-ups , 2005 .

[84]  Analía Amandi,et al.  A deterministic crowding evolutionary algorithm to form learning teams in a collaborative learning context , 2012, Expert Syst. Appl..

[85]  Nicholas R. Jennings,et al.  Coalition structure generation: A survey , 2015, Artif. Intell..

[86]  Nancy J. Cooke,et al.  On Teams, Teamwork, and Team Performance: Discoveries and Developments , 2008, Hum. Factors.

[87]  Randall S. Hansen,et al.  Benefits and Problems With Student Teams: Suggestions for Improving Team Projects , 2006 .

[88]  S. Jackson,et al.  Top management and innovations in banking: Does the composition of the top team make a difference? , 1989 .

[89]  D. Partington,et al.  Team role balance and team performance: an empirical study , 1999 .

[90]  Delroy L. Paulhus,et al.  Egoistic and Moralistic Biases in Self-Perception: The Interplay of Self-Deceptive Styles With Basic Traits and Motives , 1998 .

[91]  Gijsbert Erkens,et al.  Mediating team effectiveness in the context of collaborative learning: The importance of team and task awareness , 2011, Comput. Hum. Behav..

[92]  M. Graffar [Modern epidemiology]. , 1971, Bruxelles medical.

[93]  R. Newcombe Two-sided confidence intervals for the single proportion: comparison of seven methods. , 1998, Statistics in medicine.

[94]  Kees Ahaus,et al.  Team roles, team balance and performance , 2008 .

[95]  Jan-Willem van Aalst,et al.  Performer: an instrument for multidisciplinary courseware teams to share knowledge and experiences , 2003, Comput. Educ..

[96]  Helen M. Edwards,et al.  Who should test whom? , 2007, Commun. ACM.

[97]  Victor Kaptelinin,et al.  Group Cognition Computer Support for Building Collaborative Knowledge , 2007 .

[98]  Lorena Blasco-Arcas,et al.  Using clickers in class. The role of interactivity, active collaborative learning and engagement in learning performance , 2013, Comput. Educ..

[99]  K F Hirji,et al.  A comparison of exact, mid-P, and score tests for matched case-control studies. , 1991, Biometrics.

[100]  Cristián Zegers Ariztía,et al.  Manual , 2002 .

[101]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .