The Internet Implementation of the Hierarchical Aggregate Assessment Process with the “Cluster” Wi-Fi E-Learning and EAssessment Application — A Particular Case of Teamwork Assessment

A Wi-Fi e-learning and e-assessment Internet application named “Cluster” was devel‐ oped in the context of a research project concerning the implementation of a team‐ work assessment mobile application able to assess teams with several levels of hierarchy. Usually, teamwork assessment software and Internet applications for sev‐ eral hierarchy level teams are included in the field of Management Information Sys‐ tems (MIS). However, some assessment tasks in teams with several levels of hierarchy and assessment may be performed in an educational context, and the existing applica‐ tions for the assessment and evaluation of teams with several levels of hierarchy are not applications dedicated to the assessment of students in an educational context. The “Cluster” application is able to present the course material, to train the students in teams as well as to present individual and team assessment tasks. The application’s special functionalities enable it to assess the teams at several levels of hierarchy, which constitute the hierarchical aggregate assessment process. In effect, the members of the teams may have appointments of team member, team leader and team adminis‐ trator that supervises team leaders. This application can therefore evaluate simultane‐ ously different knowledge and skills in the same assessment task based on the hierarchical position of the team member. The summative evaluation of the applica‐ tion consists of work to submit as well as objective examinations in HTML format, while the formative evaluation is composed of assessment grid computer forms of self-assessment and peer assessment. The application contains two mutually exclusive modes, the assessor mode and the student mode. The assessor mode allows the teach‐ er to create courses, manage students, form the teams and also assess the students and the teams in a summative manner. The student mode allows the students to follow © 2015 The Author(s). Licensee InTech. This chapter is distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/3.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. courses, write exams, submit homework, perform in teams and submit selfand peers formative assessment. The theoretical consideration of the project establishes the link between hierarchical aggregate assessment applications and management information systems (MIS). The application is an electronic portfolio (e-portfolio) management system in the competency-based learning and an Internet test administration system in the mastery learning approach. The aim of the chapter is to introduce the reader to the field of hierarchical aggregate assessment and to show how to implement complex assessment tasks with several levels of hierarchy into an Internet software application.

[1]  William D. Nance Improving information systems students’ teamwork and project management capabilities: Experiences from an innovative classroom , 2000, Inf. Technol. Manag..

[2]  G. Wiggins Assessment: Authenticity, Context, and Validity. , 1993 .

[3]  Georgina Clark,et al.  La validation des épreuves d'évaluation selon l'approche par les compétences , 2007 .

[4]  D. Krathwohl A Revision of Bloom's Taxonomy: An Overview , 2002 .

[5]  Richard W. Morshead Taxonomy of Educational Objectives Handbook II: Affective Domain , 1965 .

[6]  Eileen B. Entin,et al.  Questionnaires for Distributed Assessment of Team Mutual Awareness , 2004 .

[7]  Peter Cameron,et al.  An evaluation of trauma team leader performance by video recording. , 1999, The Australian and New Zealand journal of surgery.

[8]  Daniel Cervera Elaboration d'un environnement d'experimentation en simulation incluant un cadre theorique pour l'apprentissage de l'energie des fluides , 1997 .

[9]  J. Burch,et al.  Information systems: theory and practice (5th ed.) , 1989 .

[10]  Edwin A. Fleishman,et al.  Development and evaluation of cognitive and metacognitive measures for predicting leadership potential , 2000 .

[11]  Judy Goldfinch,et al.  DEVELOPMENT OF A PEER ASSESSMENT TECHNIQUE FOR OBTAINING INDIVIDUAL MARKS ON A GROUP PROJECT , 1990 .

[12]  Olivier Rey,et al.  L'évaluation au cœur des apprentissages , 2008 .

[13]  Michael D. Mumford,et al.  Assessment of leader problem-solving capabilities. , 2000 .

[14]  Adrian Furnham,et al.  A psychometric assessment of the Belbin Team‐Role Self‐Perception Inventory , 1993 .

[15]  Diane Hart,et al.  Authentic Assessment: A Handbook for Educators , 1992 .

[16]  S. Lurie,et al.  Assessing teamwork: a reliable five-question survey. , 2011, Family medicine.

[17]  Aytaç Göğüş Peer learning and assessment , 2012 .

[18]  Use of the Mega Code to evaluate team leader performance during advanced cardiac life support , 1986, Critical care medicine.

[19]  Judy Goldfinch,et al.  Further Developments in Peer Assessment of Group Projects , 1994 .

[20]  Robert W. Lingard Teaching and Assessing Teamwork Skills in Engineering and Computer Science , 2010 .

[21]  R. Kozma Will media influence learning? Reframing the debate , 1994 .

[22]  Jaime Lloret,et al.  Improving Teamwork with University Engineering Students. The Effect of an Assessment Method to Prevent Shirking. , 2008 .

[23]  Jo McKenzie,et al.  SPARK, a confidential web-based template for self and peer assessment of student teamwork: benefits of evaluating across different subjects , 2002, Br. J. Educ. Technol..

[24]  Janet Macdonald,et al.  Assessing online collaborative learning: process and product , 2003, Comput. Educ..

[25]  Martin Riopel,et al.  An E-Assessment Website to Implement Hierarchical Aggregate Assessment , 2014 .

[26]  Martin Riopel,et al.  Research results for Mecanika: a game to learn Newtonian concepts , 2011 .

[27]  Eduardo Salas,et al.  Principles for Measuring Teamwork Skills , 1992 .

[28]  Keith Willey,et al.  Improving teamwork and engagement: the case for self and peer assessment , 2006 .

[29]  M. Volkov,et al.  Teamwork and Assessment: A Critique , 2007 .

[30]  Edwin A. Locke,et al.  Effects of Leader Role, Team-Set Goal Difficulty, Efficacy, and Tactics on Team Effectiveness , 1997 .

[31]  R. Clark Reconsidering Research on Learning from Media , 1983 .

[32]  D. Sloane,et al.  A prospective study of the performance of the trauma team leader. , 1995, The Journal of trauma.

[33]  Keith Willey,et al.  Completing the Learning Cycle: The Role of Formative Feedback When Using Self and Peer Assessment to Improve Teamwork and Engagement , 2006 .

[34]  S.G. Northrup,et al.  Multidisciplinary Teamwork Assessment: Individual Contributions and Interdisciplinary Interaction , 2006, Proceedings. Frontiers in Education. 36th Annual Conference.

[35]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[36]  Julie M. Fiskio,et al.  Evaluating physician satisfaction regarding user interactions with an electronic medical record system , 1999, AMIA.