A Two-Stage Multi-Agent Based Assessment Approach to Enhance Students' Learning Motivation through Negotiated Skills Assessment

In this paper we present an Agent-based evaluation approach in a context of Multi-agent simulation learning systems. Our evaluation model is based on a two stage assessment approach: (1) a Distributed skill evaluation combining agents and fuzzy sets theory; and (2) a Negotiation based evaluation of students’ performance during a training simulation or a Problem-solving process in a Computer-assisted learning system. This paper highlights how this approach deals with the problem of subjective evaluation of students, and shows the impact of Negotiated skills evaluation on reducing the students’ rate of dropout. This approach can also compensate the absence of human expert for assessing training results. Applied to training in plant protection, experiments' results showed first the fuzzy sets based assessment to be similar to the domain expert’s assessment and second the negotiated skills assessment to be effective in assessing students’ abilities and sustaining students’ motivation to continue learning. This evaluation approach allows us to address the problem of subjective assessment and overcome some difficulties encountered in traditional measurement models.

[1]  J. Templin,et al.  Skills Diagnosis Using IRT-Based Latent Class Models , 2007 .

[2]  Michel C. Desmarais,et al.  A review of recent advances in learner and skill modeling in intelligent learning environments , 2012, User Modeling and User-Adapted Interaction.

[3]  David L. Duhon,et al.  Evaluating and Improving Student Achievement in Business Programs: The Effective Use of Standardized Assessment Tests , 2003 .

[4]  Vania Dimitrov,et al.  The Interactive Maintenance of Open Learner Models , 1999 .

[5]  Valerie J. Shute,et al.  Games, Learning, and Assessment , 2012 .

[6]  Russell G. Almond,et al.  On the Structure of Educational Assessments, CSE Technical Report. , 2003 .

[7]  Maria Samarakou,et al.  Neuro-fuzzy knowledge processing in intelligent learning environments for improved student diagnosis , 2005, Inf. Sci..

[8]  Richard N. Van Eck.  Digital Game-Based Learning: It's Not Just the Digital Natives Who Are Restless. , 2006 .

[9]  C. Rees,et al.  The reliability of assessment criteria for undergraduate medical students' communication skills portfolios: the Nottingham experience , 2004, Medical education.

[10]  Chun-Hua Chen,et al.  Developing an Intelligent Diagnosis and Assessment E-learning Tool for Introductory Programming , 2008, J. Educ. Technol. Soc..

[11]  Yao-Ting Sung,et al.  Computer-assisted learning for mathematical problem solving , 2006, Comput. Educ..

[12]  Gregory Schraw,et al.  Metacognitive theories , 1995 .

[13]  Hiran Ekanayake,et al.  Assessing Performance Competence in Training Games , 2011, ACII.

[14]  K. Robert Lai,et al.  Modeling Peer Assessment as Agent Negotiation in a Computer Supported Collaborative Learning Environment , 2006, J. Educ. Technol. Soc..

[15]  Robert Ivor John,et al.  FUZZY METHODS FOR MEDICAL DIAGNOSIS , 2004, Appl. Artif. Intell..

[16]  Paul Brna,et al.  Negotiated Collaborative Assessment through Collaborative Student Modelling , 1999 .

[17]  John Pitts,et al.  Enhancing reliability in portfolio assessment: discussions between assessors , 2002, Medical teacher.

[18]  Roberto Pirrone,et al.  A KST-BASED SYSTEM FOR STUDENT TUTORING , 2008, Appl. Artif. Intell..

[19]  C. W. Tate.  Solve it. , 2005, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[20]  Bruce W. Tuckman,et al.  The Relative Effectiveness of Incentive Motivation and Prescribed Learning Strategy in Improving College Students' Course Performance. , 1996 .

[21]  Dirk Ifenthaler,et al.  Assessment in Game-Based Learning: Foundations, Innovations, and Perspectives , 2012 .

[22]  N. R. Jennings,et al.  To appear in: Int Journal of Group Decision and Negotiation GDN2000 Keynote Paper Automated Negotiation: Prospects, Methods and Challenges , 2022 .

[23]  D. Long,et al.  Competency-based medical education: theory to practice , 2010, Medical teacher.

[24]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[25]  Sébastien Fournier,et al.  A multi-agent system for learner assessment in serious games: Application to learning processes in crisis management , 2013, IEEE 7th International Conference on Research Challenges in Information Science (RCIS).

[26]  Reid G. Smith,et al.  The Contract Net Protocol: High-Level Communication and Control in a Distributed Problem Solver , 1980, IEEE Transactions on Computers.